-- Logs begin at Wed 2021-11-24 10:23:34 UTC, end at Wed 2021-11-24 11:38:06 UTC. -- Nov 24 11:06:51.064764 dv-cinder-804035-18-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 24 11:06:53.780052 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.common.config [-] Logging enabled! Nov 24 11:06:53.780675 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev223 Nov 24 11:06:53.780845 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103130) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 24 11:06:53.784180 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.common.config [-] Logging enabled! Nov 24 11:06:53.784402 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev223 Nov 24 11:06:53.784646 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103130) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 24 11:06:53.785950 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 11:06:53.786550 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 11:06:53.786705 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 11:06:53.787083 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 11:06:53.787504 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 11:06:53.788035 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.788627 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 24 11:06:53.788949 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.789251 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.789550 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.789852 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.790150 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.790438 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.790729 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.791034 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.791353 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.791637 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.791923 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.792214 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.792499 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] config_source = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.792787 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.793075 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.793403 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] debug = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.793704 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.794167 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.794586 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.794867 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.795157 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.795479 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.795772 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.796093 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.796380 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.796756 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] host = dv-cinder-804035-18-iscsi {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.797113 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.797503 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.797835 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.798136 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.798421 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.798724 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.799016 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.799314 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] log_dir = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.799589 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] log_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.799918 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.800266 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.800612 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.801458 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.801684 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.801935 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.802341 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.802669 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.802973 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.803271 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.803685 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.804087 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.804490 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.804794 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.805107 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.805398 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.805718 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.806000 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.806303 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.806700 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.806982 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.807327 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.807616 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.807895 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.808293 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.808684 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.809021 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.809300 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.809607 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.809896 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.810263 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.810603 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.810871 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.811144 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.811439 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.821514 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] use_journal = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.821514 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] use_json = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.821514 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.821514 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.821514 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.821514 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.821514 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.821514 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.822080 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.822080 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:53.822080 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822080 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822080 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822080 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822080 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822080 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822588 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822588 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822588 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822588 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822588 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822588 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822588 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.822588 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823122 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823122 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823122 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823122 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823122 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823122 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823122 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823122 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823669 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823669 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823669 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823669 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823669 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823669 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823669 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.823669 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.824270 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.824270 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.824270 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.824270 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.824538 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.824644 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.824919 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.825205 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.825482 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.825757 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.826039 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.826316 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.826588 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.826860 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.827137 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.827573 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.827857 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.828129 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.828399 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.828927 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.829201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.829483 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.829758 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.830032 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.830305 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.830582 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.830855 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.831129 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.831431 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.831706 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.832022 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.832299 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.832570 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.832843 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.833114 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.833384 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.833654 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.833925 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.834202 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.834474 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.834745 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.835019 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.835329 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.835585 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.835872 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.836171 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.836448 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.836726 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.837002 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.837278 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.837558 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.837833 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.838107 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.838382 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.838663 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.838936 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.839218 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.839526 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.839808 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.840117 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.840412 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.840687 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.840968 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.841243 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.841518 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.841801 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.842084 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.842376 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.842669 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.842960 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.843249 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.843566 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.843848 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.844159 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.844434 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:53.844649 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 11:06:53.844888 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=103130) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 24 11:06:54.273578 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=103130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 11:06:54.273850 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=103130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 11:06:54.274175 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=103130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 11:06:54.274487 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 24 11:06:54.596836 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.597124 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.597395 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.599096 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.599394 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.599773 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.636547 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.636826 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.637093 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.650927 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.651202 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.651495 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.679850 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.680123 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.680388 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.718257 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.718538 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.718809 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.961743 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.962351 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.962351 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.962534 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:54.963141 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.062016 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.062340 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.062617 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.062880 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.063138 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.063467 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.063721 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.063973 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.064221 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.064497 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.064749 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.065006 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.065256 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.065504 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.065753 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.066011 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.066262 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.067175 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.067479 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.067715 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.067985 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.068235 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.068517 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.068885 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.069128 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.069368 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.069763 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=103130) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 11:06:55.070000 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=103130) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 11:06:55.070233 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=103130) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 11:06:55.070464 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=103130) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 11:06:55.070693 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=103130) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 11:06:55.070920 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=103130) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 11:06:55.071278 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 24 11:06:55.074379 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 24 11:06:55.078305 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 24 11:06:55.082368 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(1200, 1249)])]) Nov 24 11:06:55.084169 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 24 11:06:55.084624 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 24 11:06:55.084959 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 24 11:06:55.085339 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 24 11:06:55.088172 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 24 11:06:55.088424 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 24 11:06:55.088763 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 24 11:06:55.093998 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 24 11:06:55.116958 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 24 11:06:55.117406 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.117704 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=103130) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Nov 24 11:06:55.118061 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.119472 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=103130) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 24 11:06:55.119750 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 24 11:06:55.119993 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 24 11:06:55.124414 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.124697 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:55.187922 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 24 11:06:55.188161 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 24 11:06:55.188396 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 24 11:06:55.188757 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 24 11:06:55.209950 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_db.sqlalchemy.engines [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 11:06:55.870641 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Initializing driver for type 'gre' Nov 24 11:06:55.871168 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] gre ID ranges: [(1, 1000)] Nov 24 11:06:56.039652 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Initializing driver for type 'local' Nov 24 11:06:56.040235 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Initializing driver for type 'vlan' Nov 24 11:06:56.125190 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] VlanTypeDriver initialization complete Nov 24 11:06:56.125554 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Initializing driver for type 'vxlan' Nov 24 11:06:56.126052 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] vxlan ID ranges: [(1, 1000)] Nov 24 11:06:56.367623 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Initializing extension driver 'port_security' Nov 24 11:06:56.367965 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.extensions.port_security [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] PortSecurityExtensionDriver initialization complete Nov 24 11:06:56.368299 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Initializing mechanism driver 'openvswitch' Nov 24 11:06:56.368621 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Initializing mechanism driver 'hyperv' Nov 24 11:06:56.375322 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.plugins.ml2.plugin [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=103130) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:06:56.376005 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > port after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.376409 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > port after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.376762 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > port after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.377298 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=103130) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 11:06:56.377727 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > subnet after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.378081 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > subnet after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.378425 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > subnet after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.378828 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=103130) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 11:06:56.379234 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > network after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.379616 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > network after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.379961 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > network after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.380362 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=103130) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 11:06:56.380782 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > security_group after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.381106 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > security_group after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.381445 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > security_group after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.381980 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=103130) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 11:06:56.382387 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.382738 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.383080 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.383509 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=103130) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 11:06:56.383927 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > address_group after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.384269 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > address_group after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.384608 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > address_group after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.385004 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=103130) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 24 11:06:56.385380 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] ML2 OVO RPC backend initialized. {{(pid=103130) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 24 11:06:56.386081 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router_interface after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.386438 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.386856 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > network before_response 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.387203 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > networks before_response 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.387580 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > port before_response 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.387922 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > ports before_response 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.393644 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > subnet before_response 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.393644 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > subnets before_response 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.393644 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > network after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.393644 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > network after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.393958 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > network after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.393958 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > port after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.393958 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > port after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.393958 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > port after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.394243 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > subnet after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.394243 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > subnet after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.394243 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > subnet after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.394243 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.plugin [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Modular L2 Plugin initialization complete Nov 24 11:06:56.394243 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading services supported by the core plugin {{(pid=103130) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 24 11:06:56.394587 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.plugins.ml2.managers [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Got port-security extension from driver 'port_security' Nov 24 11:06:56.394587 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.extensions.vlantransparent [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Disabled vlantransparent extension. Nov 24 11:06:56.394587 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=103130) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 24 11:06:56.394587 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading Plugin: router Nov 24 11:06:56.437232 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router_interface before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.437625 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router after_create 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.437993 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router before_create 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.438356 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.438731 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.439087 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router after_delete 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.439473 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > floatingip after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.439830 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > floatingip after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.440188 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router after_create 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.440535 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router after_update 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.440887 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router after_update 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.441233 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.441588 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router after_update 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.442052 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router precommit_update 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.442412 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: port after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.442788 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: port after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.443133 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: subnet after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.443497 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.443854 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > port precommit_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.444206 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router precommit_create 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.444554 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: port before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.444900 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router precommit_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.445255 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router after_update 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.445602 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router precommit_delete 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.445953 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router precommit_create 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.446314 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router_interface after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.446658 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router precommit_update 55549900 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.447023 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > agent after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.447410 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > agent after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.447765 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > network after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.448640 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Tracking information for resource: router configured {{(pid=103130) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 11:06:56.448971 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Tracking information for resource: floatingip configured {{(pid=103130) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 24 11:06:56.454386 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.db.l3_agentschedulers_db [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 24 11:06:56.454966 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: port after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.455354 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: port after_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.455713 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: port after_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.456063 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: port after_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.456863 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router before_create 55550100 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.457228 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router precommit_delete 55550100 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.457590 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router precommit_create 55550100 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.458501 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > router precommit_update 55550100 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.463396 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.services.provider_configuration [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service providers = [] {{(pid=103130) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 24 11:06:56.465394 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.db.servicetype_db [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=103130) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 24 11:06:56.468058 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.services.service_base [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=103130) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 11:06:56.468409 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.services.service_base [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=103130) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 11:06:56.468753 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.services.service_base [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=103130) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 11:06:56.469646 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.services.service_base [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=103130) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 24 11:06:56.470017 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.services.service_base [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 24 11:06:56.470396 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=103130) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 11:06:56.470715 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 24 11:06:56.482196 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=103130) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 11:06:56.482530 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading Plugin: auto_allocate Nov 24 11:06:56.488436 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: network precommit_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.488808 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: network precommit_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.489497 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=103130) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 11:06:56.489822 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading Plugin: tag Nov 24 11:06:56.496460 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=103130) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 11:06:56.496792 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading Plugin: timestamp Nov 24 11:06:56.500858 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=103130) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 11:06:56.501188 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading Plugin: network_ip_availability Nov 24 11:06:56.506757 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.507131 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.507519 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.508229 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=103130) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 11:06:56.508553 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading Plugin: flavors Nov 24 11:06:56.513329 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=103130) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 11:06:56.513666 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading Plugin: revisions Nov 24 11:06:56.518036 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=103130) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 24 11:06:56.518431 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_concurrency.lockutils [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 2.244s {{(pid=103130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 11:06:56.519183 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=103130) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 24 11:06:56.519557 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Initializing extension manager. Nov 24 11:06:56.520076 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: __init__.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.521065 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: __pycache__ {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.521488 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.521835 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: address_group.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.522602 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.523173 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: address-group Nov 24 11:06:56.523524 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: address_scope.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.534066 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.534066 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: address-scope Nov 24 11:06:56.534066 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: admin_state_down_before_update.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.534544 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.535062 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: router-admin-state-down-before-update Nov 24 11:06:56.535420 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: agent.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.536847 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.537363 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: agent Nov 24 11:06:56.537690 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: agent_resources_synced.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.538628 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.539141 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: agent-resources-synced Nov 24 11:06:56.539494 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: allowedaddresspairs.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.541303 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.541820 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: allowed-address-pairs Nov 24 11:06:56.542148 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: auto_allocated_topology.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.543233 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.543778 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: auto-allocated-topology Nov 24 11:06:56.544108 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: availability_zone.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.544804 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.545313 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: availability_zone Nov 24 11:06:56.545640 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: availability_zone_filter.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.546554 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.547060 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: availability_zone_filter Nov 24 11:06:56.547414 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: data_plane_status.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.548330 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.548835 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension data-plane-status not supported by any of loaded plugins Nov 24 11:06:56.549159 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: default_subnetpools.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.550084 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.550591 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: default-subnetpools Nov 24 11:06:56.550917 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: dhcpagentscheduler.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.552290 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.552800 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: dhcp_agent_scheduler Nov 24 11:06:56.553127 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: dns.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.554050 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.554560 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension dns-integration not supported by any of loaded plugins Nov 24 11:06:56.554885 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: dns_domain_ports.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.555834 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.556339 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 24 11:06:56.556662 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.557598 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.558104 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 24 11:06:56.558429 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: dvr.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.559104 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.559651 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: dvr Nov 24 11:06:56.559976 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: ecmp_routes.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.560903 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.561406 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 24 11:06:56.561731 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: empty_string_filtering.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.562644 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.563150 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: empty-string-filtering Nov 24 11:06:56.563509 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.564425 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.564933 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 24 11:06:56.565261 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.569143 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.569643 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 24 11:06:56.569970 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: external_net.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.570891 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.571437 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: external-net Nov 24 11:06:56.571763 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: extra_dhcp_opt.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.572680 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.573189 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: extra_dhcp_opt Nov 24 11:06:56.573513 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: extraroute.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.574419 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.574927 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: extraroute Nov 24 11:06:56.575251 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: extraroute_atomic.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.576396 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.576908 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: extraroute-atomic Nov 24 11:06:56.577238 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: filter_validation.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.577913 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.578422 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: filter-validation Nov 24 11:06:56.579011 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: fip_pf_description.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.579956 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.580463 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 24 11:06:56.580786 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: fip_port_details.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.581708 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.582223 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: fip-port-details Nov 24 11:06:56.582546 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: flavors.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.583947 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.584473 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: flavors Nov 24 11:06:56.584803 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.586500 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.587086 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 24 11:06:56.587408 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: floatingip_pools.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.588114 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.588626 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: floatingip-pools Nov 24 11:06:56.588952 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: ip_allocation.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.589888 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.590393 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension ip_allocation not supported by any of loaded plugins Nov 24 11:06:56.590740 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.591670 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.592183 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: ip-substring-filtering Nov 24 11:06:56.592512 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: l2_adjacency.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.593446 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.593955 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 24 11:06:56.594278 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: l3.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.595413 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.595938 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: router Nov 24 11:06:56.603252 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: l3_conntrack_helper.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.604372 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.604898 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 24 11:06:56.605234 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.606175 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.606693 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: ext-gw-mode Nov 24 11:06:56.607024 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.607991 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.608502 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: l3-ha Nov 24 11:06:56.608827 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: l3_flavors.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.609777 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.610254 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: l3-flavors Nov 24 11:06:56.610579 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.611529 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.612037 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 24 11:06:56.612361 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: l3agentscheduler.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.613402 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.613914 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: l3_agent_scheduler Nov 24 11:06:56.614775 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: local_ip.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.616583 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.617263 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension local_ip not supported by any of loaded plugins Nov 24 11:06:56.617842 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: logging.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.618909 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.619470 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension logging not supported by any of loaded plugins Nov 24 11:06:56.619804 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: metering.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.620546 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.621126 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: metering Nov 24 11:06:56.621454 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.622573 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.623088 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: metering_source_and_destination_fields Nov 24 11:06:56.623451 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: multiprovidernet.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.624394 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.624904 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: multi-provider Nov 24 11:06:56.625227 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: netmtu.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.626149 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.626750 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: net-mtu Nov 24 11:06:56.626981 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: netmtu_writable.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.627943 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.628457 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: net-mtu-writable Nov 24 11:06:56.628783 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: network_availability_zone.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.629463 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.630559 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: network_availability_zone Nov 24 11:06:56.630880 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: network_ip_availability.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.638484 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.638995 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: network-ip-availability Nov 24 11:06:56.639349 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: network_segment_range.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.640119 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.640631 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension network-segment-range not supported by any of loaded plugins Nov 24 11:06:56.640954 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: pagination.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.641948 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.642411 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: pagination Nov 24 11:06:56.642737 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: port_device_profile.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.643699 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.644218 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: port-device-profile Nov 24 11:06:56.644539 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.645613 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.646123 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: port-mac-address-regenerate Nov 24 11:06:56.646445 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.647405 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.647913 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: port-numa-affinity-policy Nov 24 11:06:56.648234 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: port_resource_request.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.649159 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.649664 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension port-resource-request not supported by any of loaded plugins Nov 24 11:06:56.649983 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: port_resource_request_groups.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.650959 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.651492 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 24 11:06:56.651817 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: portbindings.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.652743 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.653248 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: binding Nov 24 11:06:56.653569 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: portbindings_extended.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.654865 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.655410 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: binding-extended Nov 24 11:06:56.655741 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: portsecurity.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.656670 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.657185 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: port-security Nov 24 11:06:56.657511 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: project_id.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.658496 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.658831 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: project-id Nov 24 11:06:56.659161 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: providernet.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.666733 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.667249 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: provider Nov 24 11:06:56.667595 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: qos.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.671189 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.671752 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension qos not supported by any of loaded plugins Nov 24 11:06:56.672090 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.673366 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.673879 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 24 11:06:56.674210 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.675265 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.675806 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 24 11:06:56.676135 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: qos_default.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.677580 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.678093 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension qos-default not supported by any of loaded plugins Nov 24 11:06:56.678425 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: qos_fip.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.679076 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.679611 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension qos-fip not supported by any of loaded plugins Nov 24 11:06:56.679937 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: qos_gateway_ip.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.680873 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.681384 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 24 11:06:56.681714 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: qos_port_network_policy.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.682651 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.683147 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 24 11:06:56.683499 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.684565 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.685076 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 24 11:06:56.685400 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: qos_pps_rule.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.686575 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.687096 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension qos-pps not supported by any of loaded plugins Nov 24 11:06:56.687464 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: qos_rule_type_details.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.688388 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.688900 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 24 11:06:56.689226 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: qos_rules_alias.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.690403 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.690914 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 24 11:06:56.691241 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: quota_check_limit.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.692779 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.693298 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: quota-check-limit Nov 24 11:06:56.693623 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: quotasv2.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.694557 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.694886 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: quotas Nov 24 11:06:56.695210 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: quotasv2_detail.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.698570 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.698909 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: quota_details Nov 24 11:06:56.699239 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: rbac.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.700336 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.700866 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: rbac-policies Nov 24 11:06:56.701201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: rbac_address_group.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.702152 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.702672 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: rbac-address-group Nov 24 11:06:56.703004 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: rbac_address_scope.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.708203 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.708720 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: rbac-address-scope Nov 24 11:06:56.709047 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: rbac_security_groups.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.709974 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.710486 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: rbac-security-groups Nov 24 11:06:56.710814 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: rbac_subnetpool.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.711769 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.712278 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: rbac-subnetpool Nov 24 11:06:56.712602 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: revisionifmatch.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.713539 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.714048 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: revision-if-match Nov 24 11:06:56.714371 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: revisions.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.715522 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.716041 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: standard-attr-revisions Nov 24 11:06:56.716368 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: router_availability_zone.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.717039 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.717550 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: router_availability_zone Nov 24 11:06:56.717876 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: routerservicetype.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.718803 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.719325 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension router-service-type not supported by any of loaded plugins Nov 24 11:06:56.719654 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.720654 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.721164 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: security-groups-normalized-cidr Nov 24 11:06:56.721619 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: security_groups_port_filtering.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.722553 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.723065 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: port-security-groups-filtering Nov 24 11:06:56.723613 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.724539 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.725047 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: security-groups-remote-address-group Nov 24 11:06:56.725370 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.726317 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.726825 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: security-groups-shared-filtering Nov 24 11:06:56.727149 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.727768 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 24 11:06:56.728091 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: securitygroup.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.737999 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.738552 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: security-group Nov 24 11:06:56.738893 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: segment.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.740456 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.740971 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension segment not supported by any of loaded plugins Nov 24 11:06:56.741303 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.742277 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.742792 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 24 11:06:56.743214 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: servicetype.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.744250 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.744770 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: service-type Nov 24 11:06:56.745103 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: sorting.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.746106 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.746451 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: sorting Nov 24 11:06:56.746781 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: standard_attr_segment.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.747739 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.748256 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 24 11:06:56.748584 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: standardattrdescription.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.749255 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.749774 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: standard-attr-description Nov 24 11:06:56.750099 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: stateful_security_group.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.751045 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.751595 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: stateful-security-group Nov 24 11:06:56.751919 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: stdattrs_common.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.752656 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 24 11:06:56.752982 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.753943 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.754456 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 24 11:06:56.755360 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: subnet_onboard.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.756610 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.757137 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: subnet_onboard Nov 24 11:06:56.757464 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.758437 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.758948 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 24 11:06:56.759274 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: subnet_service_types.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.760238 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.760759 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: subnet-service-types Nov 24 11:06:56.761089 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: subnetallocation.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.762191 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.762707 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: subnet_allocation Nov 24 11:06:56.763037 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.763738 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.764251 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: subnetpool-prefix-ops Nov 24 11:06:56.764576 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.771254 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.771800 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 24 11:06:56.772131 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: tagging.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.773220 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.773735 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: standard-attr-tag Nov 24 11:06:56.774097 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: timestamp.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.775385 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.775852 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loaded extension: standard-attr-timestamp Nov 24 11:06:56.776241 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: trunk.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.777226 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.777747 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension trunk not supported by any of loaded plugins Nov 24 11:06:56.778069 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: trunk_details.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.779005 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.779556 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension trunk-details not supported by any of loaded plugins Nov 24 11:06:56.779885 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: uplink_status_propagation.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.780830 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.781341 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 24 11:06:56.781664 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Loading extension file: vlantransparent.py {{(pid=103130) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 24 11:06:56.782361 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=103130) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 24 11:06:56.782867 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 24 11:06:56.785459 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:network Nov 24 11:06:56.786042 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:subnet Nov 24 11:06:56.786563 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 11:06:56.786983 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:port Nov 24 11:06:56.788263 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.788706 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service FLAVORS assigned prefix: {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.789326 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.789751 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.790083 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:router Nov 24 11:06:56.790520 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:floatingip Nov 24 11:06:56.791009 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service METERING assigned prefix: /metering {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.792502 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.792874 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.793228 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=103130) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:06:56.794225 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of CountableResource for resource:rbac_policy Nov 24 11:06:56.794665 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:security_group Nov 24 11:06:56.795106 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 24 11:06:56.795759 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service CORE assigned prefix: {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.796088 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 11:06:56.796437 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] subnetpool is already registered Nov 24 11:06:56.796869 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service CORE assigned prefix: {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.797196 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 11:06:56.797528 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] subnetpool is already registered Nov 24 11:06:56.799813 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.800250 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service FLAVORS assigned prefix: {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.800929 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.801356 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.802334 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:router Nov 24 11:06:56.802690 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] router is already registered Nov 24 11:06:56.803105 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:floatingip Nov 24 11:06:56.803477 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] floatingip is already registered Nov 24 11:06:56.803941 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service METERING assigned prefix: /metering {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.804606 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of CountableResource for resource:rbac_policy Nov 24 11:06:56.804933 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] rbac_policy is already registered Nov 24 11:06:56.805342 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:security_group Nov 24 11:06:56.805687 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] security_group is already registered Nov 24 11:06:56.806089 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 24 11:06:56.806421 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] security_group_rule is already registered Nov 24 11:06:56.807043 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service CORE assigned prefix: {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.807401 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 11:06:56.807738 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] subnetpool is already registered Nov 24 11:06:56.808156 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.v2.resource_helper [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Service CORE assigned prefix: {{(pid=103130) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 24 11:06:56.808478 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Creating instance of TrackedResource for resource:subnetpool Nov 24 11:06:56.808809 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING neutron.quota.resource_registry [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] subnetpool is already registered Nov 24 11:06:56.809282 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: extensions {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.810775 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: address-groups {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.812301 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: address-scopes {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.813621 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: agents {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.814792 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: auto-allocated-topology {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.816075 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: availability_zones {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.818208 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: dhcp-networks {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.819670 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: dhcp-agents {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.821096 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: routers {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.824312 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: flavors {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.825523 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: service_profiles {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.826758 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: next_providers {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.828244 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: service_profiles {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.830064 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: floatingip-pools {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.831274 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: routers {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.833714 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: floatingips {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.834998 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: l3-routers {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.836437 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: l3-agents {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.837845 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: metering-labels {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.839220 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: metering-label-rules {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.840553 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: network-ip-availabilities {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.841821 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: bindings {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.843516 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: quotas {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.845079 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: quotas {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.846627 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: rbac-policies {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.847958 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: security-groups {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.849972 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: security-group-rules {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.851209 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: service-providers {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.852461 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: subnetpools {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.853883 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: subnetpools {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.855395 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: tags {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.857069 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: tags {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.858867 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: tags {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.860657 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: tags {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.862484 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: tags {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.866726 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: tags {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.869024 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: tags {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.870879 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: tags {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.872693 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: tags {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.874536 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron.api.extensions [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Extended resource: tags {{(pid=103130) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 24 11:06:56.880638 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING keystonemiddleware.auth_token [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 11:06:56.885408 dv-cinder-804035-18-iscsi neutron-server[103130]: WARNING keystonemiddleware.auth_token [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 11:06:56.894291 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_concurrency.lockutils [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Acquired lock "singleton_lock" {{(pid=103130) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 24 11:06:56.894765 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_concurrency.lockutils [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Releasing lock "singleton_lock" {{(pid=103130) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 24 11:06:56.895606 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO oslo_service.service [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Starting 2 workers Nov 24 11:06:56.900425 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Started child 103243 {{(pid=103130) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 11:06:56.904855 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Started child 103244 {{(pid=103130) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 11:06:56.905833 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:06:56.906515 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO neutron.service [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 24 11:06:56.907104 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Publish callbacks [] for process, before_spawn {{(pid=103130) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:06:56.907586 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [-] (103243) wsgi starting up on http://0.0.0.0:9696 Nov 24 11:06:56.909537 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO oslo_service.service [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Starting 1 workers Nov 24 11:06:56.909694 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:06:56.911586 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [-] (103244) wsgi starting up on http://0.0.0.0:9696 Nov 24 11:06:56.915399 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Started child 103245 {{(pid=103130) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 11:06:56.915942 dv-cinder-804035-18-iscsi neutron-server[103130]: INFO oslo_service.service [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Starting 1 workers Nov 24 11:06:56.919151 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.service [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] calling RpcWorker wait() {{(pid=103245) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 24 11:06:56.919702 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.service [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] returning from RpcWorker wait() {{(pid=103245) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 24 11:06:56.920428 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Started child 103246 {{(pid=103130) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 24 11:06:56.921062 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:06:56.921217 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG neutron_lib.callbacks.manager [None req-9491cf76-9c99-4977-8ad8-c65f897d0604 None None] Publish callbacks [] for process, after_spawn {{(pid=103130) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:06:56.921627 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:06:56.923104 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=103130) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 24 11:06:56.923337 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 11:06:56.923532 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 11:06:56.923750 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 11:06:56.924071 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 11:06:56.924252 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 11:06:56.924787 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.925078 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.925331 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.925535 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:06:56.926025 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.926025 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.926411 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.927244 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.927557 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.927825 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.928075 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.928245 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.928411 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.928664 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.928902 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.929210 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.929474 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.929717 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.929961 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.930132 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.930381 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] config_source = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.930641 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.930869 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.931134 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] debug = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.931409 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.931877 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.932121 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.932389 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.932638 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.932939 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.933201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.933474 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.933730 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.933967 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.934185 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.934437 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.934690 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.934922 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.935178 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.935430 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.935699 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.935938 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.936391 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] host = dv-cinder-804035-18-iscsi {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.936638 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.936856 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.937116 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.937374 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.937632 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.937870 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.938103 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.938349 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.938605 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.938829 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.939069 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.939357 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.939594 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_dir = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.939851 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.940015 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_options = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.940268 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.940540 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.940809 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.940997 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.941165 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.941339 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.941601 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.941765 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.942017 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.942287 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.942558 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.942726 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.942921 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.943154 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.943437 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.943688 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.943907 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.944120 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.944365 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.944596 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.944829 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.945064 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.945309 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.945546 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.945762 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.946004 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.946234 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.946468 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.946712 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.946934 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.947169 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.947441 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.947659 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.947877 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.948305 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.948441 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.948573 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.948814 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.949088 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.949317 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.949581 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.949851 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.950086 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.950315 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.950553 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.950790 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] use_journal = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.951024 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] use_json = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.951240 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.951507 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.951771 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.951986 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.952202 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.952418 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.952662 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.952906 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:56.953338 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.953863 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.954170 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.954424 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.954675 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.954922 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.955158 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.955424 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.955663 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.955917 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.956246 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.956374 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:06:56.956516 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.956748 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.957011 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.957259 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.957578 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.958212 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.958503 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.958693 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.958948 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.959192 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.959583 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.959760 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.960004 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.960258 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.960512 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.960766 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.961040 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.961303 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.961645 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.961918 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.962907 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.76/identity {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.962907 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.962907 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.963425 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.963425 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.963656 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.963793 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.963925 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.964191 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.964429 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.964644 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.964885 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.965121 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.965337 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.965585 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.965826 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.966071 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.966301 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.966520 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.966759 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.966974 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.967189 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.967442 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.967690 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.967904 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.968551 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.969173 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.969700 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.969946 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.970395 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.970645 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.971107 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.971374 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.971612 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.971825 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.972832 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.972832 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.972832 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.973043 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.973157 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.974058 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.974476 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.974705 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.974941 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.975201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.975475 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.975691 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.988201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.988201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.988201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.988201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.988201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.988201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.988201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.988201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.988201 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.989740 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.989740 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.989740 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.989740 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.989740 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.989740 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.989740 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.989740 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.990668 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.990668 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.990668 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.990668 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.990668 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.990668 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.990668 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.990668 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991219 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991219 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991219 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991219 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991219 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991219 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991219 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991219 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991812 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991812 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991812 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991812 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991812 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991812 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991812 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.991812 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992411 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992411 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992411 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992411 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992411 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992411 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992411 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992411 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992968 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992968 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992968 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992968 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992968 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992968 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992968 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992968 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.992968 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.993583 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.993583 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.993583 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.993583 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.993583 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.993583 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.993583 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.993583 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994139 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994139 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994139 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994139 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994139 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994139 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.76/identity {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994139 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994139 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994714 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994714 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994714 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994714 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.994714 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.995098 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.995098 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.995326 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.995563 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.995802 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.996017 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.996259 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.996478 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.996728 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.996942 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.997163 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.997401 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.997640 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.997859 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.998077 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.998308 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.998556 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.998793 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.999056 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.999336 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.999663 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:56.999905 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.000154 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.000411 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.000644 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.000883 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.001102 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.001321 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.001535 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.001754 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.001971 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.002200 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.002444 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.002676 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.002907 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.003139 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.003483 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.003748 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.003995 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.004211 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.004426 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.004683 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.005234 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.005234 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.005545 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.005691 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.005825 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.006054 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.006290 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.006542 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.006753 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.006963 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.007174 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.007410 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.007621 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.007984 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.008143 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.008377 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.008633 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.008854 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.009068 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.009299 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.009528 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.009739 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.009964 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.010210 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.010422 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.010648 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.010857 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.011067 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.011323 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.011544 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.011779 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.012004 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.012219 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.012450 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.012670 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.012886 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.013096 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.013351 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.013561 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.013789 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.014015 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.014231 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.014905 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.014905 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.014905 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.015137 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.015305 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.015532 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.015743 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.016048 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.016296 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.016514 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.016795 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.017057 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.017314 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.017553 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.017860 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.018075 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.018312 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.018705 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.018927 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.019356 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.019584 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.019919 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.020203 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.020823 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.021002 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.021236 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.021508 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1200:1249'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.021791 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.022005 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.022301 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.022647 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.022943 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.023187 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.023474 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.023739 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.023966 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.024185 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.024430 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.024669 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.024886 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.025131 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.025377 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.025624 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.026146 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.026146 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.026388 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.026522 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.026716 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.027325 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.027325 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.027325 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 11:06:57.027811 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=103130) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 24 11:06:57.027974 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 11:06:57.028131 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 11:06:57.028312 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 11:06:57.028640 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 11:06:57.028794 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 11:06:57.029004 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.029210 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.029307 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.029469 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.029625 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.029804 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.029964 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.030121 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.030278 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.030435 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.030593 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.030749 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.030906 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.031063 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.031219 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.031400 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.031559 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.031715 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.031878 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.032034 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] config_source = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.032192 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.032349 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.032507 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] debug = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.032664 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.032857 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.033020 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.033177 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.033333 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.033489 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.033647 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.033804 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.033959 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.034115 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.034272 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.034430 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.034586 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.034742 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.034899 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.035060 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.035217 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.035399 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.035558 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] host = dv-cinder-804035-18-iscsi {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.035714 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.036427 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.036591 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.036746 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.036905 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.037062 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.037221 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.037378 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.037535 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.037692 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.037850 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.038011 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.038166 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_dir = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.038471 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.038771 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_options = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.039081 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.039408 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.039592 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.039745 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.040274 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.040274 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.040274 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.040455 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.040539 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.040645 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.040801 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.040957 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.041113 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.041269 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.041425 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.041867 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.041867 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.041867 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.042100 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.042180 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.042309 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.042465 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.042621 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.042774 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.042932 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.043090 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.043246 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.043428 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.043586 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.043745 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.043903 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.044061 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.044221 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.044415 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.044519 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.044684 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.044838 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.045138 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.045463 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.045632 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.045783 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.045939 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.046096 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.046257 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.046413 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.046570 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] use_journal = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.046728 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] use_json = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.046886 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.047044 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.047204 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.047383 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.047544 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.047702 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.047862 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.048022 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 11:06:57.048199 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.048366 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.048532 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.048691 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.048855 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.049018 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.049177 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.049336 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.049497 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.049657 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.049823 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.049985 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.050154 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.050314 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.050472 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.050635 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.050796 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.050955 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.051116 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.051278 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.051453 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.052638 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.052800 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.052959 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.053069 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.053152 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.053315 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.053481 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.053643 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.053819 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.053980 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.054141 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.76/identity {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.054373 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.054522 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.054664 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.054797 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.054932 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.055066 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.055209 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.055380 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.055515 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.055675 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.055836 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.055997 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.056157 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.056323 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.056483 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.056645 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.056804 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.056963 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.057127 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.057318 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.057469 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.057602 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.057763 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.057923 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.058082 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.058251 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.058410 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.058648 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.058792 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.058876 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.059028 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.059186 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.059376 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.059550 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.059694 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.060007 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.060182 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.060338 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.060491 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.060645 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.060805 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.060950 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.061113 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.061272 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.061431 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.061589 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.061732 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.061896 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.062055 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.062213 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.062359 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.062521 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.062681 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.062840 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.062998 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.063157 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.063336 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.063490 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.063648 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.063812 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.063952 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.064108 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.064267 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.064426 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.064586 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.064745 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.064904 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.065063 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.065226 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.065385 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.065698 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.065858 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.066022 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.066183 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.066346 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.066506 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.066665 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.066824 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.066982 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.067442 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.067835 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.067835 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.067983 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.068103 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.068263 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.068422 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.068591 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.068749 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.068912 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.069073 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.069237 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.069406 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.069567 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.069726 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.069887 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.070106 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.070237 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.070867 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.070867 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.070867 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.070867 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.071285 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.071285 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.071285 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.071679 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.071679 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.071874 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.071874 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.072110 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.072233 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.072356 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.072477 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.072600 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.072766 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.072925 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.073085 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.073245 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.073406 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.76/identity {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.073565 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.073724 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.073884 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.074047 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.074210 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.074370 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.074530 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.074692 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.074851 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.075011 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.075172 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.075351 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.075513 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.075656 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.075818 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.075979 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.076138 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.076297 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.076462 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.076623 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.076782 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.076942 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.077101 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.077261 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.077420 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.077582 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.077741 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.077902 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.078061 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.078223 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.078382 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.079237 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.079237 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.079237 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.079237 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.079666 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.079666 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.079814 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.079891 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.080003 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.080148 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.080313 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.080472 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.080647 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.080809 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.080966 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.081126 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.081286 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.081445 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.081605 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.081764 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.081923 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.082082 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.082240 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.082401 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.082563 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.082742 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.082975 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.083443 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.083443 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.083443 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.083798 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.083798 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.083798 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.084021 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.084099 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.084264 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.084424 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.084594 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.084753 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.084912 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.085071 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.085230 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.085389 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.085557 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.085717 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.085878 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.086037 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.086195 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.086360 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.086528 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.086687 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.086846 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.087005 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.087164 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.087343 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.087513 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.087672 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.087833 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.087992 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.088150 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.088310 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.088480 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.088640 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.088799 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.088958 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.089118 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.089277 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.089444 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.089605 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.089764 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.089931 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.090089 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.090248 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.090407 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.090578 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.090738 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.090901 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.091061 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.091397 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.091565 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.091726 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.091876 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.092048 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.092215 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.092375 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.092541 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.092709 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1200:1249'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.092876 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.093037 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.093203 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.093376 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.093535 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.093694 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.093854 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.094012 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.094131 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:06:57.094232 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.094315 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.094468 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.094629 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.094789 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.094947 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.095108 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.095268 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.095453 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.095600 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.095759 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.095919 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.096080 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.096245 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.096409 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 11:06:57.096559 dv-cinder-804035-18-iscsi neutron-server[103130]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=103130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 11:06:57.248416 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 50974) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:06:57.256919 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [-] 10.222.0.76 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0064206 Nov 24 11:07:08.812653 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fba33185-623e-4d2b-a9b3-84138af3ebba None None] get_active_networks_info from dv-cinder-804035-18-iscsi {{(pid=103245) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 24 11:07:08.899785 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fba33185-623e-4d2b-a9b3-84138af3ebba None None] No non-hosted networks {{(pid=103245) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 24 11:07:08.908002 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.agentschedulers_db [None req-fba33185-623e-4d2b-a9b3-84138af3ebba None None] DHCP Agent not found on host dv-cinder-804035-18-iscsi {{(pid=103245) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 24 11:07:08.958800 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f14e0287-af23-4a5e-89dc-bc67ca03577b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1011118'] for agent, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:11.188048 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-2acb3653-f991-4ede-9ad0-6334c0b4519e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1011118'] for agent, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:11.339616 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.db.api [None req-46a1c490-6677-4525-9a96-76f432e69b3b None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-cinder-804035-18-iscsi {{(pid=103245) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 11:07:11.340271 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG oslo_db.api [None req-46a1c490-6677-4525-9a96-76f432e69b3b None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 11:07:11.933743 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-46a1c490-6677-4525-9a96-76f432e69b3b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:12.413594 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1011118'] for agent, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:14.069524 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1011118'] for agent, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:14.079751 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.db.l3_hamode_db [None req-1af977e9-8a2a-4b83-988a-d4afa0e3adaa None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 24 11:07:14.162295 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1af977e9-8a2a-4b83-988a-d4afa0e3adaa None None] Routers set() bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:07:14.162653 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1af977e9-8a2a-4b83-988a-d4afa0e3adaa None None] Router IDs set() for agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 24 11:07:14.828008 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1011118'] for agent, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:14.828982 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:14.829325 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:14.829658 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:14.829987 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:14.830315 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:14.830636 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:14.831340 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:14.831929 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:14.832671 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:14.832799 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:14.833141 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:14.833470 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:14.833855 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-804035-18-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:07:14.840659 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-804035-18-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:07:15.272744 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 51064) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:15.776636 dv-cinder-804035-18-iscsi neutron-server[103244]: WARNING oslo_policy.policy [None req-a37600f7-7857-431c-9606-73df6894cc72 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 11:07:15.777221 dv-cinder-804035-18-iscsi neutron-server[103244]: WARNING oslo_policy.policy [None req-a37600f7-7857-431c-9606-73df6894cc72 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 11:07:16.010475 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [None req-a37600f7-7857-431c-9606-73df6894cc72 admin admin] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:07:16.027327 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-a37600f7-7857-431c-9606-73df6894cc72 admin admin] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7370136 Nov 24 11:07:18.509456 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 51080) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:18.814502 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-352a686a-0cb5-476d-a75a-88fc2621e9f2 admin admin] Request body: {'subnetpool': {'default_prefixlen': 26, 'is_default': True, 'shared': True, 'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16']}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:07:18.924058 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.policy [None req-352a686a-0cb5-476d-a75a-88fc2621e9f2 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=103244) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 24 11:07:18.971520 dv-cinder-804035-18-iscsi neutron-server[103244]: WARNING oslo_policy.policy [None req-352a686a-0cb5-476d-a75a-88fc2621e9f2 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 11:07:18.971918 dv-cinder-804035-18-iscsi neutron-server[103244]: WARNING oslo_policy.policy [None req-352a686a-0cb5-476d-a75a-88fc2621e9f2 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 11:07:18.981024 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.quota [None req-352a686a-0cb5-476d-a75a-88fc2621e9f2 admin admin] Loaded quota_driver: . Nov 24 11:07:19.126777 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-352a686a-0cb5-476d-a75a-88fc2621e9f2 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789860636144', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789860633549', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789860640466', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789860621771', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789860627592', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8789860731804', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-7930512', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-7932155', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-556069', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-990705'] for rbac-policy, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:19.363105 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-352a686a-0cb5-476d-a75a-88fc2621e9f2 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:19.364367 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-352a686a-0cb5-476d-a75a-88fc2621e9f2 admin admin] 10.222.0.76 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.8538954 Nov 24 11:07:22.039960 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 51092) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:22.337850 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Request body: {'network': {'project_id': '6c89a65cae0949f2bbe2301084079a21', 'admin_state_up': True, 'name': 'private', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:07:22.418585 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Made reservation on behalf of 6c89a65cae0949f2bbe2301084079a21 for: {'network': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:07:22.423814 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:22.440056 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:22.547609 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:22.679120 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:22.702677 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1211} {{(pid=103244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:07:22.727868 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8789864228527', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:22.730502 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Unsubscribe: segment precommit_create {{(pid=103244) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 24 11:07:22.730502 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.segments_db [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Added segment 6c752bb5-11a3-4657-b319-03a43e78130c of type vlan for network 0a9f69a7-9c1c-4910-9f28-8fb9671616a5 Nov 24 11:07:22.743920 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2992771-0a51-4dcf-ab3c-5f1ffa21b6a7,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:22.791697 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:22.792051 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:22.792381 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:22.792704 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:22.793023 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:22.793353 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:22.793673 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:22.794000 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:22.794315 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:22.794626 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:22.794934 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:22.795239 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Tracked resource versions report: Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: pushed versions: Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: { 'AddressGroup': {'1.2'}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'ConntrackHelper': {'1.0'}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Log': {'1.0'}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Network': {'1.1'}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Port': {'1.7'}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'PortForwarding': {'1.2'}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'QosPolicy': {'1.10'}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'SecurityGroup': {'1.5'}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'SecurityGroupRule': {'1.2'}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'SubPort': {'1.0'}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Subnet': {'1.1'}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Trunk': {'1.1'}} Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: consumer versions: Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: { DHCP agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: L3 agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: Metadata agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: Metering agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: Open vSwitch agent@dv-cinder-804035-18-iscsi: { 'AddressGroup': '1.2', Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'ConntrackHelper': '1.0', Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Log': '1.0', Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Network': '1.1', Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Port': '1.7', Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'PortForwarding': '1.2', Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'QosPolicy': '1.10', Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'SecurityGroup': '1.5', Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'SecurityGroupRule': '1.2', Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'SubPort': '1.0', Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Subnet': '1.1', Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Trunk': '1.1'}} Nov 24 11:07:22.796606 dv-cinder-804035-18-iscsi neutron-server[103244]: {{(pid=103244) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 11:07:22.848617 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:22.975960 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:22.977152 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:07:22.977835 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:23.073099 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] Pushing event updated for resources: {'Network': ['ID=0a9f69a7-9c1c-4910-9f28-8fb9671616a5,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:23.084349 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 0a9f69a7-9c1c-4910-9f28-8fb9671616a5 details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:07:23.118584 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-d5051247-7af6-4b3b-b011-994abf7c59f4 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 850 time: 1.0774956 Nov 24 11:07:25.834836 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51106) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:26.323302 dv-cinder-804035-18-iscsi neutron-server[103243]: WARNING oslo_policy.policy [None req-b086d021-d7a2-4657-a03f-dbedc482ea59 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 11:07:26.323888 dv-cinder-804035-18-iscsi neutron-server[103243]: WARNING oslo_policy.policy [None req-b086d021-d7a2-4657-a03f-dbedc482ea59 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 11:07:26.770263 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.policy [None req-b086d021-d7a2-4657-a03f-dbedc482ea59 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=103243) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 24 11:07:26.817510 dv-cinder-804035-18-iscsi neutron-server[103243]: WARNING oslo_policy.policy [None req-b086d021-d7a2-4657-a03f-dbedc482ea59 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 11:07:26.817879 dv-cinder-804035-18-iscsi neutron-server[103243]: WARNING oslo_policy.policy [None req-b086d021-d7a2-4657-a03f-dbedc482ea59 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 24 11:07:26.825986 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b086d021-d7a2-4657-a03f-dbedc482ea59 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:07:26.827708 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-b086d021-d7a2-4657-a03f-dbedc482ea59 admin admin] 10.222.0.76 "GET /v2.0/networks/0a9f69a7-9c1c-4910-9f28-8fb9671616a5 HTTP/1.1" status: 200 len: 826 time: 0.9919612 Nov 24 11:07:26.866713 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-46db53cd-c982-417a-913d-dce03de95b23 admin admin] 10.222.0.76 "GET /v2.0/subnetpools/d4499006-096d-401c-9ccb-1789f41e6b44 HTTP/1.1" status: 200 len: 734 time: 0.0322089 Nov 24 11:07:26.876098 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Request body: {'subnet': {'ip_version': 4, 'name': 'private-subnet', 'subnetpool_id': 'd4499006-096d-401c-9ccb-1789f41e6b44', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'gateway_ip': '172.20.0.1', 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:07:26.877701 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.quota [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Loaded quota_driver: . Nov 24 11:07:26.978028 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Made reservation on behalf of 6c89a65cae0949f2bbe2301084079a21 for: {'subnet': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:07:26.980992 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:27.342246 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for subnet, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:27.413850 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Checking segment: {'id': '6c752bb5-11a3-4657-b319-03a43e78130c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1211, 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:07:27.414265 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Network hostable DHCP agents. Network: 0a9f69a7-9c1c-4910-9f28-8fb9671616a5, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103243) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:07:27.422752 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Pushing event updated for resources: {'Subnet': ['ID=adbe34e7-69b0-435b-ba1a-d5b9ae83608a,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:27.434196 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:27.434558 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:27.434896 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:27.435227 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:27.435582 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:27.435923 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:27.436250 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:27.436585 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:27.436908 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:27.437224 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:27.437610 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:27.437929 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Tracked resource versions report: Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: pushed versions: Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: { 'AddressGroup': {'1.2'}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'ConntrackHelper': {'1.0'}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Log': {'1.0'}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Network': {'1.1'}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Port': {'1.7'}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'PortForwarding': {'1.2'}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'QosPolicy': {'1.10'}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'SecurityGroup': {'1.5'}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'SecurityGroupRule': {'1.2'}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'SubPort': {'1.0'}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Subnet': {'1.1'}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Trunk': {'1.1'}} Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: consumer versions: Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: { DHCP agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: L3 agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: Metadata agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: Metering agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: Open vSwitch agent@dv-cinder-804035-18-iscsi: { 'AddressGroup': '1.2', Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'ConntrackHelper': '1.0', Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Log': '1.0', Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Network': '1.1', Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Port': '1.7', Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'PortForwarding': '1.2', Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'QosPolicy': '1.10', Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'SecurityGroup': '1.5', Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'SecurityGroupRule': '1.2', Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'SubPort': '1.0', Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Subnet': '1.1', Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Trunk': '1.1'}} Nov 24 11:07:27.439244 dv-cinder-804035-18-iscsi neutron-server[103243]: {{(pid=103243) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 11:07:27.536743 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Network 0a9f69a7-9c1c-4910-9f28-8fb9671616a5 is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103243) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:07:27.606806 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 0a9f69a7-9c1c-4910-9f28-8fb9671616a5) {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:07:27.611859 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:07:27.612987 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:27.616630 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1956606f-301b-4205-a198-473a124c3141 None None] Network 0a9f69a7-9c1c-4910-9f28-8fb9671616a5 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:07:27.695721 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-1412ac4d-f899-4516-a060-0c8c513eaa24 admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.8229685 Nov 24 11:07:27.938076 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1e1181f3-c521-552f-a8c5-b0ec988a193c-0a9f69a7-9c1c-4910-9f28-8fb9671616a5', 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'fixed_ips': [{'subnet_id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a'}]}} from dv-cinder-804035-18-iscsi. {{(pid=103245) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 11:07:27.939385 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:28.237565 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.db_base_plugin_common [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Allocated IP 172.20.0.2 (0a9f69a7-9c1c-4910-9f28-8fb9671616a5/adbe34e7-69b0-435b-ba1a-d5b9ae83608a/8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8) {{(pid=103245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:07:28.438864 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Publish callbacks [] for port, precommit_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:28.527831 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:28.601502 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Network 0a9f69a7-9c1c-4910-9f28-8fb9671616a5 is already hosted by enough agents. {{(pid=103245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:07:28.606813 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.base_scheduler [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Resources bound (agent type, host, resource id): {{(pid=103245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:07:28.610213 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Received port after_create {{(pid=103245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:07:28.622163 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Pushing event updated for resources: {'Port': ['ID=8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8,revision_number=1']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:28.668043 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:28.668404 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:28.668749 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:28.669081 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:28.669409 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:28.669835 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:28.670173 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:28.670497 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:28.670833 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:28.671156 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:28.671497 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:28.671815 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Tracked resource versions report: Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: pushed versions: Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: { 'AddressGroup': {'1.2'}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'ConntrackHelper': {'1.0'}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Log': {'1.0'}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Network': {'1.1'}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Port': {'1.7'}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'PortForwarding': {'1.2'}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'QosPolicy': {'1.10'}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'SecurityGroup': {'1.5'}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'SecurityGroupRule': {'1.2'}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'SubPort': {'1.0'}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Subnet': {'1.1'}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Trunk': {'1.1'}} Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: consumer versions: Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: { DHCP agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: L3 agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: Metadata agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: Metering agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: Open vSwitch agent@dv-cinder-804035-18-iscsi: { 'AddressGroup': '1.2', Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'ConntrackHelper': '1.0', Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Log': '1.0', Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Network': '1.1', Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Port': '1.7', Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'PortForwarding': '1.2', Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'QosPolicy': '1.10', Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'SecurityGroup': '1.5', Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'SecurityGroupRule': '1.2', Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'SubPort': '1.0', Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Subnet': '1.1', Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Trunk': '1.1'}} Nov 24 11:07:28.673177 dv-cinder-804035-18-iscsi neutron-server[103245]: {{(pid=103245) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 11:07:28.708014 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Attempting to bind port 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:07:28.708411 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Attempting to bind port 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': '6c752bb5-11a3-4657-b319-03a43e78130c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1211, 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:07:28.708823 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Attempting to bind port 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8 on network 0a9f69a7-9c1c-4910-9f28-8fb9671616a5 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:07:28.713652 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 7, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:07:28.714038 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Checking segment: {'id': '6c752bb5-11a3-4657-b319-03a43e78130c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1211, 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:07:28.714494 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:28.714879 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Bound using segment: {'id': '6c752bb5-11a3-4657-b319-03a43e78130c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1211, 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:07:28.715387 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Bound port: 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6c752bb5-11a3-4657-b319-03a43e78130c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1211, 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:07:28.715801 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:28.776982 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] For port 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:07:28.781302 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] For port 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8,segment=NetworkSegment(6c752bb5-11a3-4657-b319-03a43e78130c),segment_id=6c752bb5-11a3-4657-b319-03a43e78130c)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:07:28.830507 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:28.900251 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c15de60-512e-41c2-ac9d-fadfe22f575e None None] Pushing event updated for resources: {'Port': ['ID=8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:30.277010 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51126) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:30.600055 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [None req-75ced6ae-118b-4f0c-983c-0e640d0baca8 admin admin] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103243) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:07:30.601153 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-75ced6ae-118b-4f0c-983c-0e640d0baca8 admin admin] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3230369 Nov 24 11:07:33.125924 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51134) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:33.454048 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [None req-e349c3eb-ba3e-44d1-a8be-6fdd8159423f admin admin] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103243) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:07:33.455040 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-e349c3eb-ba3e-44d1-a8be-6fdd8159423f admin admin] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3281989 Nov 24 11:07:33.980712 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 5 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:07:36.270253 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51144) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:36.573957 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-64307809-4a11-462c-95d7-bcc5bd6895d2 admin admin] Request body: {'router': {'name': 'router1', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'admin_state_up': True}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:07:36.667691 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-64307809-4a11-462c-95d7-bcc5bd6895d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1010094', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:36.669343 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-64307809-4a11-462c-95d7-bcc5bd6895d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1009794', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-534758', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-985777', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-654'] for router, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:36.819885 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-64307809-4a11-462c-95d7-bcc5bd6895d2 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:36.876483 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-64307809-4a11-462c-95d7-bcc5bd6895d2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1009813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-942685'] for router, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:36.945780 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-64307809-4a11-462c-95d7-bcc5bd6895d2 admin admin] Publish callbacks [] for router, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:36.946994 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-64307809-4a11-462c-95d7-bcc5bd6895d2 admin admin] 10.222.0.76 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.6756446 Nov 24 11:07:38.018142 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f31b36e7-5472-49b5-8310-ad47f59601ff None None] Network 0a9f69a7-9c1c-4910-9f28-8fb9671616a5 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:07:38.100293 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-4ffc81f6-2518-405c-b21d-0eb029ef62b4 None None] Provisioning complete for port 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:07:38.100681 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4ffc81f6-2518-405c-b21d-0eb029ef62b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:38.312558 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4ffc81f6-2518-405c-b21d-0eb029ef62b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:38.358283 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-4ffc81f6-2518-405c-b21d-0eb029ef62b4 None None] For port 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8,segment=NetworkSegment(6c752bb5-11a3-4657-b319-03a43e78130c),segment_id=6c752bb5-11a3-4657-b319-03a43e78130c)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:07:38.442491 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4ffc81f6-2518-405c-b21d-0eb029ef62b4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:38.492412 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ffc81f6-2518-405c-b21d-0eb029ef62b4 None None] Pushing event updated for resources: {'Port': ['ID=8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:38.534856 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:07:38.586248 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d192ebe9-d297-431b-99da-293eaa32a239 None None] Provisioning complete for port 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:07:38.586611 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d192ebe9-d297-431b-99da-293eaa32a239 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:38.632286 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:07:38.632545 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:38.817999 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-554d91db-7599-4238-a0ac-e1a143310c54 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:39.460870 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51158) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:39.766535 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [None req-827bd93c-f24e-4ef4-8797-08d48af837d4 admin admin] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103243) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:07:39.767577 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-827bd93c-f24e-4ef4-8797-08d48af837d4 admin admin] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3057451 Nov 24 11:07:40.481301 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:07:40.527621 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:07:40.527983 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:41.152941 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d34efb5b-7ff0-4493-85f4-0675b5528682 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:42.248940 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51172) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:42.369904 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:42.476329 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Request body: {'network': {'admin_state_up': True, 'provider:physical_network': 'physnet1', 'provider:network_type': 'flat', 'name': 'public', 'router:external': True, 'is_default': True}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:07:42.589125 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Made reservation on behalf of 6d5447513b7540cabb64d7d4a805e5df for: {'network': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:07:42.591516 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:42.608526 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:42.707615 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:42.764157 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:42.779435 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Reserving flat network on physical network physnet1 {{(pid=103243) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 24 11:07:42.805635 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f347724-a028-47ae-8848-c8e9dc13afb5,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:42.810315 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8789864228527', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:42.810949 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Unsubscribe: segment precommit_create {{(pid=103243) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 24 11:07:42.811431 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.segments_db [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Added segment bdf7c96b-efac-48c4-9baf-722b3b6d5627 of type flat for network fa6231d1-a629-42bc-a091-20035dee3542 Nov 24 11:07:42.863899 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:42.958370 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:42.959227 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:07:42.959831 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:43.048272 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] Pushing event updated for resources: {'Network': ['ID=fa6231d1-a629-42bc-a091-20035dee3542,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:43.058523 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network fa6231d1-a629-42bc-a091-20035dee3542 details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:07:43.075754 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-48868366-e74d-4c96-ba9e-2403b26d4991 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.8256304 Nov 24 11:07:43.955305 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:44.798547 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:45.415975 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51190) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:45.532410 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f37da043-6833-4abd-9a09-703538da0be0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:07:45.533728 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-f37da043-6833-4abd-9a09-703538da0be0 admin admin] 10.222.0.76 "GET /v2.0/subnets/adbe34e7-69b0-435b-ba1a-d5b9ae83608a HTTP/1.1" status: 200 len: 849 time: 0.1168041 Nov 24 11:07:45.656437 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-ba065864-828b-41cd-84bc-dec6be5c49e9 admin admin] 10.222.0.76 "GET /v2.0/routers/86198526-8dde-407c-b314-52a4318cdbd9 HTTP/1.1" status: 200 len: 704 time: 0.1164436 Nov 24 11:07:45.919213 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:46.209465 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Allocated IP 172.20.0.1 (0a9f69a7-9c1c-4910-9f28-8fb9671616a5/adbe34e7-69b0-435b-ba1a-d5b9ae83608a/539adb7b-4ba0-43aa-8c08-7af572ab5524) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:07:46.366034 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:46.525220 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:46.598573 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Network 0a9f69a7-9c1c-4910-9f28-8fb9671616a5 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:07:46.603033 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:07:46.609279 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:07:46.609704 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1009482'] for router_interface, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:46.667280 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Pushing event updated for resources: {'Port': ['ID=539adb7b-4ba0-43aa-8c08-7af572ab5524,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:46.795612 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-b5dd1068-5773-4ed4-9cee-33ca56073d60 None None] Provisioning complete for port 539adb7b-4ba0-43aa-8c08-7af572ab5524 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:07:46.796098 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b5dd1068-5773-4ed4-9cee-33ca56073d60 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:46.829813 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-b5dd1068-5773-4ed4-9cee-33ca56073d60 None None] Port 539adb7b-4ba0-43aa-8c08-7af572ab5524 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:07:46.869957 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:47.082903 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:47.152684 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:47.153474 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-636370', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1009638'] for router_interface, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:47.212099 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Pushing event updated for resources: {'Port': ['ID=539adb7b-4ba0-43aa-8c08-7af572ab5524,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:47.281983 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Network 0a9f69a7-9c1c-4910-9f28-8fb9671616a5 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:07:47.283354 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:07:47.452216 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-7c2b790a-d7b1-46c4-aaf3-c154179de794 None None] Provisioning complete for port 539adb7b-4ba0-43aa-8c08-7af572ab5524 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:07:47.452589 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-7c2b790a-d7b1-46c4-aaf3-c154179de794 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:47.488077 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-7c2b790a-d7b1-46c4-aaf3-c154179de794 None None] Port 539adb7b-4ba0-43aa-8c08-7af572ab5524 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:07:47.509253 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Router 86198526-8dde-407c-b314-52a4318cdbd9 is scheduled to L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 with binding_index 1 {{(pid=103243) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 11:07:47.599356 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:07:47.604605 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-41adc3e5-a6e5-4238-bbfe-580380815838 admin admin] 10.222.0.76 "PUT /v2.0/routers/86198526-8dde-407c-b314-52a4318cdbd9/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.9420042 Nov 24 11:07:47.622579 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Sync routers for ids ['86198526-8dde-407c-b314-52a4318cdbd9'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:07:47.635579 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Routers {'86198526-8dde-407c-b314-52a4318cdbd9'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:07:47.636407 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:07:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['86198526-8dde-407c-b314-52a4318cdbd9'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:07:47.824600 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Set router 86198526-8dde-407c-b314-52a4318cdbd9 gateway port host: None {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:07:48.255098 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86198526-8dde-407c-b314-52a4318cdbd9', 'name': 'router1', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:07:36Z', 'updated_at': '2021-11-24T11:07:46Z', 'revision_number': 2, 'project_id': '6c89a65cae0949f2bbe2301084079a21', 'gw_port_host': None, '_interfaces': [{'id': '539adb7b-4ba0-43aa-8c08-7af572ab5524', 'name': '', 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'mac_address': 'fa:16:3e:f8:8e:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86198526-8dde-407c-b314-52a4318cdbd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:07:45Z', 'updated_at': '2021-11-24T11:07:46Z', 'revision_number': 2, 'project_id': '6c89a65cae0949f2bbe2301084079a21', 'subnets': [{'id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'd4499006-096d-401c-9ccb-1789f41e6b44'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:07:48.309467 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Checking router: 86198526-8dde-407c-b314-52a4318cdbd9 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:07:48.309833 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Updating router 86198526-8dde-407c-b314-52a4318cdbd9 port 539adb7b-4ba0-43aa-8c08-7af572ab5524 binding host dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:07:48.357730 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:48.862351 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Publish callbacks [] for port, precommit_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:48.943588 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:49.117422 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Pushing event updated for resources: {'Port': ['ID=539adb7b-4ba0-43aa-8c08-7af572ab5524,revision_number=3']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:49.119223 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-1449d614-6e4f-4056-903d-a3c726ba881e None None] Provisioning complete for port 539adb7b-4ba0-43aa-8c08-7af572ab5524 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:07:49.119750 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-1449d614-6e4f-4056-903d-a3c726ba881e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:49.121964 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Attempting to bind port 539adb7b-4ba0-43aa-8c08-7af572ab5524 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:07:49.122373 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Attempting to bind port 539adb7b-4ba0-43aa-8c08-7af572ab5524 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': '6c752bb5-11a3-4657-b319-03a43e78130c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1211, 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5'}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:07:49.128203 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Attempting to bind port 539adb7b-4ba0-43aa-8c08-7af572ab5524 on network 0a9f69a7-9c1c-4910-9f28-8fb9671616a5 {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:07:49.130449 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:49.130808 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:49.131150 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:49.131508 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:49.131841 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:49.132177 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:49.132503 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:49.132826 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:49.133164 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:49.133489 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:49.133810 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:49.134127 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Tracked resource versions report: Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: pushed versions: Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: { 'AddressGroup': {'1.2'}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'ConntrackHelper': {'1.0'}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Log': {'1.0'}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Network': {'1.1'}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Port': {'1.7'}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'PortForwarding': {'1.2'}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'QosPolicy': {'1.10'}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'SecurityGroup': {'1.5'}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'SecurityGroupRule': {'1.2'}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'SubPort': {'1.0'}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Subnet': {'1.1'}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Trunk': {'1.1'}} Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: consumer versions: Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: { DHCP agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: L3 agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: Metadata agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: Metering agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: Open vSwitch agent@dv-cinder-804035-18-iscsi: { 'AddressGroup': '1.2', Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'ConntrackHelper': '1.0', Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Log': '1.0', Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Network': '1.1', Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Port': '1.7', Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'PortForwarding': '1.2', Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'QosPolicy': '1.10', Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'SecurityGroup': '1.5', Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'SecurityGroupRule': '1.2', Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'SubPort': '1.0', Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Subnet': '1.1', Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Trunk': '1.1'}} Nov 24 11:07:49.135478 dv-cinder-804035-18-iscsi neutron-server[103246]: {{(pid=103246) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 11:07:49.137943 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 7, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:07:49.138346 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Checking segment: {'id': '6c752bb5-11a3-4657-b319-03a43e78130c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1211, 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:07:49.138801 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:49.139176 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Bound using segment: {'id': '6c752bb5-11a3-4657-b319-03a43e78130c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1211, 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5'} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:07:49.139684 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Bound port: 539adb7b-4ba0-43aa-8c08-7af572ab5524, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6c752bb5-11a3-4657-b319-03a43e78130c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1211, 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5'}}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:07:49.140073 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:49.170491 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-1449d614-6e4f-4056-903d-a3c726ba881e None None] Port 539adb7b-4ba0-43aa-8c08-7af572ab5524 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:07:49.208618 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] For port 539adb7b-4ba0-43aa-8c08-7af572ab5524, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:07:49.227734 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] For port 539adb7b-4ba0-43aa-8c08-7af572ab5524, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=539adb7b-4ba0-43aa-8c08-7af572ab5524,segment=NetworkSegment(6c752bb5-11a3-4657-b319-03a43e78130c),segment_id=6c752bb5-11a3-4657-b319-03a43e78130c)] {{(pid=103246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:07:49.319726 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:49.374740 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51bbecf4-676c-48d1-97b9-7a4607cdac1b None None] Pushing event updated for resources: {'Port': ['ID=539adb7b-4ba0-43aa-8c08-7af572ab5524,revision_number=4']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:49.383956 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Routers {'86198526-8dde-407c-b314-52a4318cdbd9'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:07:49.384549 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:07:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['86198526-8dde-407c-b314-52a4318cdbd9'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:07:49.477183 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] Set router 86198526-8dde-407c-b314-52a4318cdbd9 gateway port host: None {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:07:49.590558 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-b4cff113-f16b-415f-bb04-982eba41d1ea None None] Provisioning complete for port 539adb7b-4ba0-43aa-8c08-7af572ab5524 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:07:49.590925 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b4cff113-f16b-415f-bb04-982eba41d1ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:49.673180 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b4cff113-f16b-415f-bb04-982eba41d1ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:49.694169 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86198526-8dde-407c-b314-52a4318cdbd9', 'name': 'router1', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:07:36Z', 'updated_at': '2021-11-24T11:07:46Z', 'revision_number': 2, 'project_id': '6c89a65cae0949f2bbe2301084079a21', 'gw_port_host': None, '_interfaces': [{'id': '539adb7b-4ba0-43aa-8c08-7af572ab5524', 'name': '', 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'mac_address': 'fa:16:3e:f8:8e:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86198526-8dde-407c-b314-52a4318cdbd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:07:45Z', 'updated_at': '2021-11-24T11:07:49Z', 'revision_number': 4, 'project_id': '6c89a65cae0949f2bbe2301084079a21', 'subnets': [{'id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'd4499006-096d-401c-9ccb-1789f41e6b44'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:07:49.705848 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-b4cff113-f16b-415f-bb04-982eba41d1ea None None] For port 539adb7b-4ba0-43aa-8c08-7af572ab5524, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=539adb7b-4ba0-43aa-8c08-7af572ab5524,segment=NetworkSegment(6c752bb5-11a3-4657-b319-03a43e78130c),segment_id=6c752bb5-11a3-4657-b319-03a43e78130c)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:07:49.726749 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d633ec12-d159-4db1-8011-96ecb603c716 None None] The sync data for ids ['86198526-8dde-407c-b314-52a4318cdbd9'] in dv-cinder-804035-18-iscsi is: [{'id': '86198526-8dde-407c-b314-52a4318cdbd9', 'name': 'router1', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:07:36Z', 'updated_at': '2021-11-24T11:07:46Z', 'revision_number': 2, 'project_id': '6c89a65cae0949f2bbe2301084079a21', 'gw_port_host': None, '_interfaces': [{'id': '539adb7b-4ba0-43aa-8c08-7af572ab5524', 'name': '', 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'mac_address': 'fa:16:3e:f8:8e:16', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86198526-8dde-407c-b314-52a4318cdbd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:07:45Z', 'updated_at': '2021-11-24T11:07:49Z', 'revision_number': 4, 'project_id': '6c89a65cae0949f2bbe2301084079a21', 'subnets': [{'id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'd4499006-096d-401c-9ccb-1789f41e6b44'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:07:49.784223 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b4cff113-f16b-415f-bb04-982eba41d1ea None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:49.834027 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4cff113-f16b-415f-bb04-982eba41d1ea None None] Pushing event updated for resources: {'Port': ['ID=539adb7b-4ba0-43aa-8c08-7af572ab5524,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:50.010716 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51204) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:50.127769 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-78aa3bd2-c635-4866-8a3e-2305c72fa7b8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:07:50.127769 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-78aa3bd2-c635-4866-8a3e-2305c72fa7b8 admin admin] 10.222.0.76 "GET /v2.0/networks/fa6231d1-a629-42bc-a091-20035dee3542 HTTP/1.1" status: 200 len: 842 time: 0.1126890 Nov 24 11:07:50.134413 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] Request body: {'subnet': {'ip_version': 4, 'enable_dhcp': False, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'name': 'public-subnet', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:07:50.278731 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] Made reservation on behalf of 6d5447513b7540cabb64d7d4a805e5df for: {'subnet': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:07:50.281034 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] Publish callbacks [] for subnet, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:50.633903 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.objects.ports [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=103243) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 24 11:07:50.634325 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for subnet, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:50.686769 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] Pushing event updated for resources: {'Subnet': ['ID=741c8451-f41e-4184-b25a-74d54247c82b,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:50.696180 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] Checking segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:07:50.696521 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] Network hostable DHCP agents. Network: fa6231d1-a629-42bc-a091-20035dee3542, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103243) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:07:50.792936 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] Network fa6231d1-a629-42bc-a091-20035dee3542 is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103243) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:07:50.880736 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, fa6231d1-a629-42bc-a091-20035dee3542) {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:07:50.884957 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:07:50.885544 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:50.892419 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e105d34-dc18-4d66-8517-328ae46fae67 None None] Network fa6231d1-a629-42bc-a091-20035dee3542 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:07:50.969124 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-8aab32fa-8489-474f-b395-a19116fd4c7f admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8379824 Nov 24 11:07:51.028896 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c554b34-778c-41b2-8d22-16bbb59ce717 None None] Network fa6231d1-a629-42bc-a091-20035dee3542 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:07:53.358612 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51212) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:53.568236 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-4ae9fcd3-2828-434f-89e3-526c634dd55a admin admin] 10.222.0.76 "GET /v2.0/routers/86198526-8dde-407c-b314-52a4318cdbd9 HTTP/1.1" status: 200 len: 710 time: 0.2083824 Nov 24 11:07:53.652521 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cb1c54e7-9526-4688-988a-92e99cffd6a7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:07:53.653857 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-cb1c54e7-9526-4688-988a-92e99cffd6a7 admin admin] 10.222.0.76 "GET /v2.0/networks/fa6231d1-a629-42bc-a091-20035dee3542 HTTP/1.1" status: 200 len: 886 time: 0.0796552 Nov 24 11:07:53.663457 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:07:53.904942 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:54.239661 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:54.316594 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:54.418047 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Allocated IP 172.27.3.40 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/c56ea25d-a71d-4727-93da-e75ef5f98cac) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:07:54.520645 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:54.635347 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:54.676107 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:07:54.680458 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:07:54.685619 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:07:54.688686 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Pushing event updated for resources: {'Port': ['ID=c56ea25d-a71d-4727-93da-e75ef5f98cac,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:55.012462 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:55.306621 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-571085', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1009820', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-668'] for router, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:55.310133 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-942685', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-569321', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-942666', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1009838'] for router, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:55.421488 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Router 86198526-8dde-407c-b314-52a4318cdbd9 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:07:55.530772 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:07:55.534924 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] Publish callbacks [] for router, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:55.536134 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-a53b8358-17c6-431d-99b1-ee9e6eb72a36 admin admin] 10.222.0.76 "PUT /v2.0/routers/86198526-8dde-407c-b314-52a4318cdbd9 HTTP/1.1" status: 200 len: 889 time: 1.8758800 Nov 24 11:07:56.520171 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 539adb7b-4ba0-43aa-8c08-7af572ab5524 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:07:56.568190 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 539adb7b-4ba0-43aa-8c08-7af572ab5524 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:07:56.568556 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:56.692781 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Sync routers for ids ['86198526-8dde-407c-b314-52a4318cdbd9'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:07:56.704137 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Routers {'86198526-8dde-407c-b314-52a4318cdbd9'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:07:56.704714 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:07:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['86198526-8dde-407c-b314-52a4318cdbd9'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:07:56.915370 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Set router 86198526-8dde-407c-b314-52a4318cdbd9 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:07:57.372742 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86198526-8dde-407c-b314-52a4318cdbd9', 'name': 'router1', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'c56ea25d-a71d-4727-93da-e75ef5f98cac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:07:36Z', 'updated_at': '2021-11-24T11:07:54Z', 'revision_number': 4, 'project_id': '6c89a65cae0949f2bbe2301084079a21', 'gw_port': {'id': 'c56ea25d-a71d-4727-93da-e75ef5f98cac', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:f6:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86198526-8dde-407c-b314-52a4318cdbd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:07:54Z', 'updated_at': '2021-11-24T11:07:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '539adb7b-4ba0-43aa-8c08-7af572ab5524', 'name': '', 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'mac_address': 'fa:16:3e:f8:8e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86198526-8dde-407c-b314-52a4318cdbd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:07:45Z', 'updated_at': '2021-11-24T11:07:49Z', 'revision_number': 5, 'project_id': '6c89a65cae0949f2bbe2301084079a21', 'subnets': [{'id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'd4499006-096d-401c-9ccb-1789f41e6b44'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:07:57.425720 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Checking router: 86198526-8dde-407c-b314-52a4318cdbd9 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:07:57.426068 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Updating router 86198526-8dde-407c-b314-52a4318cdbd9 port c56ea25d-a71d-4727-93da-e75ef5f98cac binding host dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:07:57.472789 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:57.787045 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Publish callbacks [] for port, precommit_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:57.861197 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:57.914843 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Attempting to bind port c56ea25d-a71d-4727-93da-e75ef5f98cac on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:07:57.915217 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Attempting to bind port c56ea25d-a71d-4727-93da-e75ef5f98cac by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:07:57.915603 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Attempting to bind port c56ea25d-a71d-4727-93da-e75ef5f98cac on network fa6231d1-a629-42bc-a091-20035dee3542 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:07:57.918381 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa26094a-df19-4d27-84da-939bbbc771a2 None None] Pushing event updated for resources: {'Port': ['ID=c56ea25d-a71d-4727-93da-e75ef5f98cac,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:57.922845 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 7, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:07:57.923225 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Checking segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:07:57.923649 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:57.924860 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Bound using segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:07:57.925421 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Bound port: c56ea25d-a71d-4727-93da-e75ef5f98cac, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:07:57.925824 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:57.975905 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] For port c56ea25d-a71d-4727-93da-e75ef5f98cac, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:07:57.978861 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] For port c56ea25d-a71d-4727-93da-e75ef5f98cac, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=c56ea25d-a71d-4727-93da-e75ef5f98cac,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:07:58.058335 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:07:58.074928 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 51224) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:07:58.119653 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Routers {'86198526-8dde-407c-b314-52a4318cdbd9'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:07:58.120264 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:07:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['86198526-8dde-407c-b314-52a4318cdbd9'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:07:58.122918 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa26094a-df19-4d27-84da-939bbbc771a2 None None] Pushing event updated for resources: {'Port': ['ID=c56ea25d-a71d-4727-93da-e75ef5f98cac,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:07:58.233680 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-93f7adcd-99c7-4616-bb60-e1046e18ea2d admin admin] 10.222.0.76 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1481767 Nov 24 11:07:58.233909 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] Set router 86198526-8dde-407c-b314-52a4318cdbd9 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:07:58.460897 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '86198526-8dde-407c-b314-52a4318cdbd9', 'name': 'router1', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'c56ea25d-a71d-4727-93da-e75ef5f98cac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:07:36Z', 'updated_at': '2021-11-24T11:07:54Z', 'revision_number': 4, 'project_id': '6c89a65cae0949f2bbe2301084079a21', 'gw_port': {'id': 'c56ea25d-a71d-4727-93da-e75ef5f98cac', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:f6:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86198526-8dde-407c-b314-52a4318cdbd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:07:54Z', 'updated_at': '2021-11-24T11:07:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '539adb7b-4ba0-43aa-8c08-7af572ab5524', 'name': '', 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'mac_address': 'fa:16:3e:f8:8e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86198526-8dde-407c-b314-52a4318cdbd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:07:45Z', 'updated_at': '2021-11-24T11:07:49Z', 'revision_number': 5, 'project_id': '6c89a65cae0949f2bbe2301084079a21', 'subnets': [{'id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'd4499006-096d-401c-9ccb-1789f41e6b44'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:07:58.487055 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-115ceebd-3d78-4483-af78-83fe13fcd8a9 None None] The sync data for ids ['86198526-8dde-407c-b314-52a4318cdbd9'] in dv-cinder-804035-18-iscsi is: [{'id': '86198526-8dde-407c-b314-52a4318cdbd9', 'name': 'router1', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.40'}], 'enable_snat': True}, 'gw_port_id': 'c56ea25d-a71d-4727-93da-e75ef5f98cac', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:07:36Z', 'updated_at': '2021-11-24T11:07:54Z', 'revision_number': 4, 'project_id': '6c89a65cae0949f2bbe2301084079a21', 'gw_port': {'id': 'c56ea25d-a71d-4727-93da-e75ef5f98cac', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:5a:f6:8a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '86198526-8dde-407c-b314-52a4318cdbd9', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.40', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:07:54Z', 'updated_at': '2021-11-24T11:07:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '539adb7b-4ba0-43aa-8c08-7af572ab5524', 'name': '', 'network_id': '0a9f69a7-9c1c-4910-9f28-8fb9671616a5', 'tenant_id': '6c89a65cae0949f2bbe2301084079a21', 'mac_address': 'fa:16:3e:f8:8e:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '86198526-8dde-407c-b314-52a4318cdbd9', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:07:45Z', 'updated_at': '2021-11-24T11:07:49Z', 'revision_number': 5, 'project_id': '6c89a65cae0949f2bbe2301084079a21', 'subnets': [{'id': 'adbe34e7-69b0-435b-ba1a-d5b9ae83608a', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'd4499006-096d-401c-9ccb-1789f41e6b44'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:08:00.536568 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device c56ea25d-a71d-4727-93da-e75ef5f98cac up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:08:00.605726 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port c56ea25d-a71d-4727-93da-e75ef5f98cac triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:08:00.606382 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:00.693890 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:00.717403 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] For port c56ea25d-a71d-4727-93da-e75ef5f98cac, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=c56ea25d-a71d-4727-93da-e75ef5f98cac,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:08:00.806126 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:00.854316 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Pushing event updated for resources: {'Port': ['ID=c56ea25d-a71d-4727-93da-e75ef5f98cac,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:08:02.550768 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device c56ea25d-a71d-4727-93da-e75ef5f98cac up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:08:02.651094 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port c56ea25d-a71d-4727-93da-e75ef5f98cac triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:08:02.651510 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:08.783067 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-dc60931f-ed3c-4b2f-9d7e-a8b2314c5460 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:10.978623 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 5 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:08:11.154520 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-807cbcdd-3721-48ed-8018-6b4a02c977f4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:12.377798 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:13.981495 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:14.789460 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:38.742716 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-24486d92-d067-415f-bb9c-9cce5290e132 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:41.159475 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-3e13740f-e049-42e2-b22e-33b7e3891fd2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:42.410621 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:43.970938 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:44.814550 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:08:47.977113 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 5 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:09:08.733664 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-3556b662-e7c2-4426-9f11-97e87967f17d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:11.133800 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b6f66636-e258-4fdc-a872-cd630c15abd8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:12.402259 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:13.998327 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:14.804204 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:20.430067 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 51708) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:09:20.497248 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.pecan_wsgi.hooks.translation [None req-5f6cc57c-3e3d-4b4c-910c-2f58417f29eb admin admin] GET failed (client error): The resource could not be found. Nov 24 11:09:20.498510 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-5f6cc57c-3e3d-4b4c-910c-2f58417f29eb admin admin] 10.222.0.76 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0675142 Nov 24 11:09:20.681168 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c87513c5-768f-42a7-9f9e-60907baae20b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:20.682513 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-c87513c5-768f-42a7-9f9e-60907baae20b admin admin] 10.222.0.76 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 873 time: 0.1793332 Nov 24 11:09:22.964141 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51718) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:09:23.058233 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4f4d4728-ffbd-434e-8681-5a24a3bdfe23 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:23.059517 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-4f4d4728-ffbd-434e-8681-5a24a3bdfe23 admin admin] 10.222.0.76 "GET /v2.0/subnets/adbe34e7-69b0-435b-ba1a-d5b9ae83608a HTTP/1.1" status: 200 len: 849 time: 0.0943007 Nov 24 11:09:23.069406 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:09:23.152410 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Publish callbacks [] for subnet, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:23.381006 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8789864134521'] for subnet, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:23.412153 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:23.412736 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:23.414022 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] 10.222.0.76 "PUT /v2.0/subnets/adbe34e7-69b0-435b-ba1a-d5b9ae83608a HTTP/1.1" status: 200 len: 868 time: 0.3482974 Nov 24 11:09:23.416766 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e91e15da-e3a4-497f-8343-80b785ac9e50 None None] Network 0a9f69a7-9c1c-4910-9f28-8fb9671616a5 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:09:23.434565 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=adbe34e7-69b0-435b-ba1a-d5b9ae83608a,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:09:23.442562 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:09:23.442920 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:09:23.443271 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:09:23.443632 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:09:23.444106 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:09:23.444444 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:09:23.444770 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:09:23.445090 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:09:23.445417 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:09:23.445733 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:09:23.446054 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:09:23.446369 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cdfd616c-e8d3-4f19-8b36-907d67acc6e3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:09:23.819140 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-3c3c87d9-5203-40de-b416-8d2642044b70 None None] Provisioning complete for port 8cbd6aec-9d98-44c4-8c78-dc1d8cb945d8 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:09:23.819533 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-3c3c87d9-5203-40de-b416-8d2642044b70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:23.905564 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-3c3c87d9-5203-40de-b416-8d2642044b70 None None] Provisioning complete for port 539adb7b-4ba0-43aa-8c08-7af572ab5524 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:09:23.905821 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-3c3c87d9-5203-40de-b416-8d2642044b70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:24.976560 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 5 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:09:25.717343 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51728) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:09:25.913369 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4749cdc1-ad19-44fe-ae7e-a6c27fbe4e17 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:25.913752 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4749cdc1-ad19-44fe-ae7e-a6c27fbe4e17 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:25.915283 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-4749cdc1-ad19-44fe-ae7e-a6c27fbe4e17 admin admin] 10.222.0.76 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1550 time: 0.1969676 Nov 24 11:09:28.185938 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51736) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:09:28.319708 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc27f6b-1e74-4519-a1e0-d553720d48a3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:28.320174 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6cc27f6b-1e74-4519-a1e0-d553720d48a3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:28.321695 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-6cc27f6b-1e74-4519-a1e0-d553720d48a3 admin admin] 10.222.0.76 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1550 time: 0.1348393 Nov 24 11:09:30.577879 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51744) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:09:30.708322 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-489ac25c-e5ed-4fbc-aed9-7dd4737e0602 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:30.709664 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-489ac25c-e5ed-4fbc-aed9-7dd4737e0602 admin admin] 10.222.0.76 "GET /v2.0/networks/0a9f69a7-9c1c-4910-9f28-8fb9671616a5 HTTP/1.1" status: 200 len: 870 time: 0.1306014 Nov 24 11:09:33.036523 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51752) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:09:33.165437 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c05f4be8-eefe-4250-8bf4-d2076adbf087 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:33.166835 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-c05f4be8-eefe-4250-8bf4-d2076adbf087 admin admin] 10.222.0.76 "GET /v2.0/networks/fa6231d1-a629-42bc-a091-20035dee3542 HTTP/1.1" status: 200 len: 886 time: 0.1294515 Nov 24 11:09:35.429719 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51760) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:09:35.551897 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67a4bdb8-d206-4657-9853-085f2d163004 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:35.552339 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67a4bdb8-d206-4657-9853-085f2d163004 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:35.553824 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-67a4bdb8-d206-4657-9853-085f2d163004 admin admin] 10.222.0.76 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1231418 Nov 24 11:09:37.813635 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51768) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:09:37.902932 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8cbaf936-d229-488c-bd6e-af6d02037379 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:37.903406 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8cbaf936-d229-488c-bd6e-af6d02037379 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:37.904886 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-8cbaf936-d229-488c-bd6e-af6d02037379 admin admin] 10.222.0.76 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0902646 Nov 24 11:09:38.773171 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b4ced39d-5944-4f19-bbfc-0761ae4dfae0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:40.209226 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51776) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:09:40.293669 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-25f2c330-a95f-4c78-a842-f60e14aeb5df admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:40.294979 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-25f2c330-a95f-4c78-a842-f60e14aeb5df admin admin] 10.222.0.76 "GET /v2.0/subnets/741c8451-f41e-4184-b25a-74d54247c82b HTTP/1.1" status: 200 len: 816 time: 0.0847466 Nov 24 11:09:41.134732 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-bd4801e6-0c11-447d-a421-bf92518d537c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:42.384858 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:42.596830 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51784) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:09:42.687203 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a14af6f1-320a-4291-8bf5-456cba238873 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:09:42.688600 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-a14af6f1-320a-4291-8bf5-456cba238873 admin admin] 10.222.0.76 "GET /v2.0/subnets/adbe34e7-69b0-435b-ba1a-d5b9ae83608a HTTP/1.1" status: 200 len: 868 time: 0.0908191 Nov 24 11:09:43.985213 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:09:44.797743 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:01.975315 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 5 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:10:07.312061 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51838) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:10:07.366602 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [None req-b57b7f1b-deae-414a-b832-15450d4ce119 admin admin] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103243) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:10:07.367609 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-b57b7f1b-deae-414a-b832-15450d4ce119 admin admin] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0545206 Nov 24 11:10:08.722512 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-713a33df-6c98-4be9-8eec-c26439b98862 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:09.732613 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51846) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:10:09.792451 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.pecan_wsgi.hooks.translation [None req-3265f864-d7a7-449f-a34e-fea225a08f3d admin admin] GET failed (client error): The resource could not be found. Nov 24 11:10:09.793708 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-3265f864-d7a7-449f-a34e-fea225a08f3d admin admin] 10.222.0.76 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0600839 Nov 24 11:10:09.935156 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ef15f1d-dee0-4bc5-81f7-3bcb5d984735 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:10:09.936601 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-7ef15f1d-dee0-4bc5-81f7-3bcb5d984735 admin admin] 10.222.0.76 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1378586 Nov 24 11:10:11.143721 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f4052707-fa10-4cc2-b831-bf29b9b35a12 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:12.254794 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51854) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:10:12.301242 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] Request body: {'network': {'shared': True, 'admin_state_up': True, 'name': 'shared'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:10:12.373436 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:12.385093 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] Made reservation on behalf of 6d5447513b7540cabb64d7d4a805e5df for: {'network': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:10:12.387403 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:12.417050 dv-cinder-804035-18-iscsi neutron-server[103243]: WARNING neutron.services.revisions.revision_plugin [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] Could not find related network for resource to bump revision. Nov 24 11:10:12.430392 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1214} {{(pid=103243) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:10:12.439692 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:12.439961 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.segments_db [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] Added segment cd60819a-febf-4221-b2e4-966d325c3c03 of type vlan for network 4c664793-4f02-4ee0-8065-d295f3934f2c Nov 24 11:10:12.584781 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:12.699775 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:12.700626 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:10:12.701194 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:12.758661 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] Pushing event updated for resources: {'Network': ['ID=4c664793-4f02-4ee0-8065-d295f3934f2c,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:10:12.769051 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 4c664793-4f02-4ee0-8065-d295f3934f2c details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:10:12.800375 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-563ec8bf-e9cb-400c-a315-ac8d51fbad56 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 848 time: 0.5443799 Nov 24 11:10:13.978003 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:14.790774 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:15.134204 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 51862) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:10:15.193943 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.pecan_wsgi.hooks.translation [None req-1eaa18bd-6890-4f8c-90a9-388a60c54540 admin admin] GET failed (client error): The resource could not be found. Nov 24 11:10:15.195184 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-1eaa18bd-6890-4f8c-90a9-388a60c54540 admin admin] 10.222.0.76 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0600560 Nov 24 11:10:15.265554 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8f43f02-3f52-4885-84db-02fefd176958 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:10:15.266954 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-b8f43f02-3f52-4885-84db-02fefd176958 admin admin] 10.222.0.76 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 827 time: 0.0672951 Nov 24 11:10:15.277219 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Request body: {'subnet': {'name': 'shared-subnet', 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c', 'description': 'shared-subnet', 'ip_version': 4, 'cidr': '192.168.233.0/24'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:10:15.384839 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Made reservation on behalf of 6d5447513b7540cabb64d7d4a805e5df for: {'subnet': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:10:15.387074 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Publish callbacks [] for subnet, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:15.676571 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for subnet, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:15.734963 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Pushing event updated for resources: {'Subnet': ['ID=788d9121-5618-4111-9367-9c60f72fb59c,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:10:15.745634 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:15.745995 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:15.746329 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:15.746657 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:15.746979 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:15.747337 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:15.747663 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:15.747981 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:15.748298 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:15.748608 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:15.748921 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:15.749230 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:15.755059 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Checking segment: {'id': 'cd60819a-febf-4221-b2e4-966d325c3c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1214, 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:10:15.755461 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Network hostable DHCP agents. Network: 4c664793-4f02-4ee0-8065-d295f3934f2c, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:10:15.847947 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Network 4c664793-4f02-4ee0-8065-d295f3934f2c is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:10:15.939435 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 4c664793-4f02-4ee0-8065-d295f3934f2c) {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:10:15.944701 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:10:15.945725 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:15.948840 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9dc783d4-710e-479d-b865-07382665ffae None None] Network 4c664793-4f02-4ee0-8065-d295f3934f2c requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:10:16.034222 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-89158da7-def2-4225-ba29-2dc61e0f554d admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.7603800 Nov 24 11:10:16.189324 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1e1181f3-c521-552f-a8c5-b0ec988a193c-4c664793-4f02-4ee0-8065-d295f3934f2c', 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c', 'tenant_id': '6d5447513b7540cabb64d7d4a805e5df', 'fixed_ips': [{'subnet_id': '788d9121-5618-4111-9367-9c60f72fb59c'}]}} from dv-cinder-804035-18-iscsi. {{(pid=103245) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 11:10:16.190352 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:16.398472 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.db_base_plugin_common [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Allocated IP 192.168.233.2 (4c664793-4f02-4ee0-8065-d295f3934f2c/788d9121-5618-4111-9367-9c60f72fb59c/a72a54ad-207b-467e-b727-a71a1a0c017f) {{(pid=103245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:10:16.540438 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Publish callbacks [] for port, precommit_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:16.607029 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:16.649792 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Network 4c664793-4f02-4ee0-8065-d295f3934f2c is already hosted by enough agents. {{(pid=103245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:10:16.652524 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.base_scheduler [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Resources bound (agent type, host, resource id): {{(pid=103245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:10:16.655020 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Received port after_create {{(pid=103245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:10:16.666551 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Pushing event updated for resources: {'Port': ['ID=a72a54ad-207b-467e-b727-a71a1a0c017f,revision_number=1']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:10:16.690605 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:16.690976 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:16.691339 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:16.691688 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:16.692019 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:16.692364 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:16.692696 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:16.693025 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:16.693364 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:16.694027 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:16.694364 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:16.694688 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:10:16.728429 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Attempting to bind port a72a54ad-207b-467e-b727-a71a1a0c017f on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:10:16.728794 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Attempting to bind port a72a54ad-207b-467e-b727-a71a1a0c017f by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'cd60819a-febf-4221-b2e4-966d325c3c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1214, 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:10:16.729154 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Attempting to bind port a72a54ad-207b-467e-b727-a71a1a0c017f on network 4c664793-4f02-4ee0-8065-d295f3934f2c {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:10:16.734238 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 10, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:10:16.735712 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Checking segment: {'id': 'cd60819a-febf-4221-b2e4-966d325c3c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1214, 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:10:16.736126 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:16.736517 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Bound using segment: {'id': 'cd60819a-febf-4221-b2e4-966d325c3c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1214, 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:10:16.736984 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Bound port: a72a54ad-207b-467e-b727-a71a1a0c017f, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cd60819a-febf-4221-b2e4-966d325c3c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1214, 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:10:16.737384 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:16.801427 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] For port a72a54ad-207b-467e-b727-a71a1a0c017f, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:10:16.804664 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] For port a72a54ad-207b-467e-b727-a71a1a0c017f, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a72a54ad-207b-467e-b727-a71a1a0c017f,segment=NetworkSegment(cd60819a-febf-4221-b2e4-966d325c3c03),segment_id=cd60819a-febf-4221-b2e4-966d325c3c03)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:10:16.904439 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:16.981167 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc9596de-e7f7-460e-a5bb-c2341d1e3078 None None] Pushing event updated for resources: {'Port': ['ID=a72a54ad-207b-467e-b727-a71a1a0c017f,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:10:17.774282 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fbd0bb3c-f285-4e16-a25e-aaa7c7130f4d None None] Network 4c664793-4f02-4ee0-8065-d295f3934f2c requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:10:17.861016 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-52479efe-34bb-415a-abc9-68f05155e0cc None None] Provisioning complete for port a72a54ad-207b-467e-b727-a71a1a0c017f triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:10:17.861372 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-52479efe-34bb-415a-abc9-68f05155e0cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:17.997030 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-52479efe-34bb-415a-abc9-68f05155e0cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:18.039218 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-52479efe-34bb-415a-abc9-68f05155e0cc None None] For port a72a54ad-207b-467e-b727-a71a1a0c017f, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a72a54ad-207b-467e-b727-a71a1a0c017f,segment=NetworkSegment(cd60819a-febf-4221-b2e4-966d325c3c03),segment_id=cd60819a-febf-4221-b2e4-966d325c3c03)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:10:18.139720 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-52479efe-34bb-415a-abc9-68f05155e0cc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:18.197588 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52479efe-34bb-415a-abc9-68f05155e0cc None None] Pushing event updated for resources: {'Port': ['ID=a72a54ad-207b-467e-b727-a71a1a0c017f,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:10:18.262818 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d01063ae-c090-4c94-8ba7-a2dbd76a3ee3 None None] Provisioning complete for port a72a54ad-207b-467e-b727-a71a1a0c017f triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:10:18.263232 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d01063ae-c090-4c94-8ba7-a2dbd76a3ee3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:18.586727 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a72a54ad-207b-467e-b727-a71a1a0c017f up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:10:18.638707 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port a72a54ad-207b-467e-b727-a71a1a0c017f triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:10:18.639065 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:38.709841 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-77c50baa-0a71-49b8-8894-2ec806ef45c8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:38.973975 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 5 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:10:41.167405 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4f6e399a-7915-438b-9479-1dba95c0534e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:42.401815 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:43.982865 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:10:44.800462 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:08.732064 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-75f39417-97c5-465c-a222-4b6a0da25ab2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:11.142247 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5ae127ad-96a8-4ffc-aabf-690c4f076324 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:12.400579 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:13.972138 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:14.817836 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:15.971851 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 5 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:11:36.206801 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 51906) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:11:36.212739 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [None req-a7dd5e34-f468-4888-a72a-a097b51b0fb6 tempest-verify_tempest_config-52313393 tempest-verify_tempest_config-52313393-project] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:11:36.213737 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-a7dd5e34-f468-4888-a72a-a097b51b0fb6 tempest-verify_tempest_config-52313393 tempest-verify_tempest_config-52313393-project] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0058587 Nov 24 11:11:36.685158 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 51924) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:11:36.791148 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:36.863362 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:36.931119 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:36.978661 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=cb7855dc7e1849dcbd188c166daca812&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2924776 Nov 24 11:11:36.979482 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d967423f-e78f-4258-9c74-52c9bb9903f0,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:11:36.981663 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 51928) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:11:36.986792 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:36.987281 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:36.987744 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:36.988088 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:36.988424 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:36.988757 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:36.989086 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:36.989433 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:36.989788 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:36.990119 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:36.990469 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:36.990789 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ac4c187-8aca-4fc0-a6df-e9b4f50d4f4b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:37.036363 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:37.059960 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:37.215934 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:37.219075 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:37.220262 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/d967423f-e78f-4258-9c74-52c9bb9903f0 HTTP/1.1" status: 204 len: 168 time: 0.2375042 Nov 24 11:11:37.228289 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d967423f-e78f-4258-9c74-52c9bb9903f0,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:11:37.235806 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:37.236175 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:37.236518 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:37.236852 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:37.237180 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:37.237523 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:37.237929 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:37.238180 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:37.238507 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:37.238830 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:37.239146 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:37.239494 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e93bbb69-f1ef-4089-8aa2-0ebfb3a960aa admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:11:38.731239 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-2a64780d-6990-40a7-9d33-69050e2ad496 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:41.152758 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-492fc386-53d1-44a7-8d4d-21647e402820 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:42.394263 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:43.986864 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:45.114057 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:11:52.970658 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 5 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:12:08.741909 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-ec001fd6-987f-4f36-a099-9cbedeb5bb9f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:12:11.146969 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-bbe22872-d001-4ed6-82a1-18e208840d33 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:12:12.387225 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:12:14.004360 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:12:14.770108 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:12:29.969569 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 5 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:12:38.740467 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-654ba126-5650-4329-a7e3-9141dbf191f6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:12:41.156901 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-3e650711-246e-4716-9bce-28d7fb93920c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:12:42.397407 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:12:43.991994 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:12:44.769307 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:13:06.969761 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 5 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:13:08.705242 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6a280de1-cff6-475d-94a4-95c07de0f85a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:13:09.093214 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1011118'] for agent, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:13:11.168393 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-15509830-bb40-4a24-ba20-537aa8a8759f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:13:12.385402 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:13:13.974403 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:13:14.767949 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:13:24.054333 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52002) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:13:24.155888 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-e79839c4-e565-4efa-97e5-90bcd0284758 admin admin] 10.222.0.76 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4559 time: 0.1005356 Nov 24 11:13:26.471048 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52012) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:13:26.526625 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2b51f407-355e-489a-a1aa-3ff43187bf6a admin admin] 10.222.0.76 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4559 time: 0.0544772 Nov 24 11:13:38.721635 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-736bda17-070e-4d3b-bb24-fe8393b17067 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:13:39.058887 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:13:41.144047 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-53c703a3-d1f2-4c66-901a-8a69d3384aec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:13:42.379240 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:13:43.968849 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:13:43.995458 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:13:44.784539 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:08.715449 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c7a95d76-d2ae-4a95-bcda-3c6b5e1e460a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:09.070257 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:11.166648 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-3415c88d-c848-49ba-bbf4-46e7e3db2be0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:12.377797 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:13.989157 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:14.794818 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:20.968195 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:14:38.725663 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-1f63b63a-190e-42e1-aea7-5ecb85ece5df None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:39.045597 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:41.160446 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-2a9d64ea-be4c-4fab-a8c2-3caee5c7f075 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:42.393760 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:43.976741 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:44.776579 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:53.189886 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52088) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:14:53.464975 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-network', 'tenant_id': '70ea7b83799640618db2c87847a8ecea'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:14:53.611189 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Made reservation on behalf of 70ea7b83799640618db2c87847a8ecea for: {'network': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:14:53.614593 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:53.625285 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:53.739866 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:54.068300 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:54.092783 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1229} {{(pid=103244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:14:54.108359 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81469fbe-dad0-4d00-a4bc-8241ae461749,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:54.110708 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:54.111046 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.segments_db [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Added segment 82d2fb61-1d5d-4699-8932-ea33f5f3dc2b of type vlan for network 76fcee22-81e5-4608-a546-3b68c56c5ac7 Nov 24 11:14:54.128438 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:54.129405 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:54.129796 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:54.130177 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:54.130535 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:54.130886 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:54.131221 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:54.131590 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:54.131918 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:54.132238 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:54.132557 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:54.132872 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Tracked resource versions report: Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: pushed versions: Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: { 'AddressGroup': {'1.2'}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'ConntrackHelper': {'1.0'}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Log': {'1.0'}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Network': {'1.1'}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Port': {'1.7'}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'PortForwarding': {'1.2'}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'QosPolicy': {'1.10'}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'SecurityGroup': {'1.5'}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'SecurityGroupRule': {'1.2'}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'SubPort': {'1.0'}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Subnet': {'1.1'}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Trunk': {'1.1'}} Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: consumer versions: Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: { DHCP agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: HyperV agent@hv-cinder-80403: {}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: L3 agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: Metadata agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: Metering agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: Open vSwitch agent@dv-cinder-804035-18-iscsi: { 'AddressGroup': '1.2', Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'ConntrackHelper': '1.0', Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Log': '1.0', Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Network': '1.1', Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Port': '1.7', Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'PortForwarding': '1.2', Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'QosPolicy': '1.10', Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'SecurityGroup': '1.5', Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'SecurityGroupRule': '1.2', Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'SubPort': '1.0', Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Subnet': '1.1', Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: 'Trunk': '1.1'}} Nov 24 11:14:54.133967 dv-cinder-804035-18-iscsi neutron-server[103244]: {{(pid=103244) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 11:14:54.184145 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:54.319925 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:54.321138 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:14:54.321747 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:54.389051 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] Pushing event updated for resources: {'Network': ['ID=76fcee22-81e5-4608-a546-3b68c56c5ac7,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:54.400619 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 76fcee22-81e5-4608-a546-3b68c56c5ac7 details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:14:54.408027 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-e558059f-e433-4b78-9920-5861cfb6d3fa admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.2152166 Nov 24 11:14:54.411126 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52150) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:14:54.416618 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-1a933f16-8ed1-4c3c-a1b5-fc84723672f7 admin admin] Request body: {'subnet': {'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-subnet', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:14:54.508083 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a933f16-8ed1-4c3c-a1b5-fc84723672f7 admin admin] Made reservation on behalf of 70ea7b83799640618db2c87847a8ecea for: {'subnet': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:14:54.510415 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1a933f16-8ed1-4c3c-a1b5-fc84723672f7 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:54.736896 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1a933f16-8ed1-4c3c-a1b5-fc84723672f7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for subnet, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:54.802072 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a933f16-8ed1-4c3c-a1b5-fc84723672f7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5eae2e87-935a-45b7-89da-586ce04ad644,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:54.809342 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a933f16-8ed1-4c3c-a1b5-fc84723672f7 admin admin] Checking segment: {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:14:54.809680 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a933f16-8ed1-4c3c-a1b5-fc84723672f7 admin admin] Network hostable DHCP agents. Network: 76fcee22-81e5-4608-a546-3b68c56c5ac7, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:14:54.868022 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a933f16-8ed1-4c3c-a1b5-fc84723672f7 admin admin] Network 76fcee22-81e5-4608-a546-3b68c56c5ac7 is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:14:54.914026 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-1a933f16-8ed1-4c3c-a1b5-fc84723672f7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 76fcee22-81e5-4608-a546-3b68c56c5ac7) {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:14:54.918425 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a933f16-8ed1-4c3c-a1b5-fc84723672f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:14:54.919142 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1a933f16-8ed1-4c3c-a1b5-fc84723672f7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:54.925032 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c3b18d88-b360-4e56-a3a3-8a45b0047113 None None] Network 76fcee22-81e5-4608-a546-3b68c56c5ac7 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:14:54.997268 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-1a933f16-8ed1-4c3c-a1b5-fc84723672f7 admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 853 time: 0.5850146 Nov 24 11:14:55.004534 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52176) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:14:55.016680 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:14:55.073489 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1e1181f3-c521-552f-a8c5-b0ec988a193c-76fcee22-81e5-4608-a546-3b68c56c5ac7', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644'}]}} from dv-cinder-804035-18-iscsi. {{(pid=103245) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 11:14:55.074511 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.131040 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1010094', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.132118 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1009794', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-534758', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-985777', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-654'] for router, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.186305 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.214773 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.db_base_plugin_common [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Allocated IP 172.20.0.2 (76fcee22-81e5-4608-a546-3b68c56c5ac7/5eae2e87-935a-45b7-89da-586ce04ad644/6ff81879-9cc7-46c5-824f-661a525a56bd) {{(pid=103245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:14:55.314043 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52192) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:14:55.365691 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Publish callbacks [] for port, precommit_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.405548 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.440083 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.479928 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Network 76fcee22-81e5-4608-a546-3b68c56c5ac7 is already hosted by enough agents. {{(pid=103245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:14:55.482655 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.base_scheduler [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Resources bound (agent type, host, resource id): {{(pid=103245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:14:55.486019 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Received port after_create {{(pid=103245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:14:55.493001 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Pushing event updated for resources: {'Port': ['ID=6ff81879-9cc7-46c5-824f-661a525a56bd,revision_number=1']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:55.502533 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:55.502903 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:55.503242 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:55.503594 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:55.504456 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:55.504772 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:55.505097 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:55.505417 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:55.505753 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:55.506077 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:55.506392 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:55.506716 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Tracked resource versions report: Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: pushed versions: Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: { 'AddressGroup': {'1.2'}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'ConntrackHelper': {'1.0'}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Log': {'1.0'}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Network': {'1.1'}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Port': {'1.7'}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'PortForwarding': {'1.2'}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'QosPolicy': {'1.10'}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'SecurityGroup': {'1.5'}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'SecurityGroupRule': {'1.2'}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'SubPort': {'1.0'}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Subnet': {'1.1'}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Trunk': {'1.1'}} Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: consumer versions: Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: { DHCP agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: HyperV agent@hv-cinder-80403: {}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: L3 agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: Metadata agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: Metering agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: Open vSwitch agent@dv-cinder-804035-18-iscsi: { 'AddressGroup': '1.2', Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'ConntrackHelper': '1.0', Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Log': '1.0', Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Network': '1.1', Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Port': '1.7', Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'PortForwarding': '1.2', Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'QosPolicy': '1.10', Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'SecurityGroup': '1.5', Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'SecurityGroupRule': '1.2', Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'SubPort': '1.0', Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Subnet': '1.1', Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: 'Trunk': '1.1'}} Nov 24 11:14:55.507841 dv-cinder-804035-18-iscsi neutron-server[103245]: {{(pid=103245) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 11:14:55.567418 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Attempting to bind port 6ff81879-9cc7-46c5-824f-661a525a56bd on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:14:55.567793 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Attempting to bind port 6ff81879-9cc7-46c5-824f-661a525a56bd by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:14:55.568147 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Attempting to bind port 6ff81879-9cc7-46c5-824f-661a525a56bd on network 76fcee22-81e5-4608-a546-3b68c56c5ac7 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:14:55.573702 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 14, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:14:55.574326 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Checking segment: {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:14:55.574917 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.575359 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Bound using segment: {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:14:55.575801 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Bound port: 6ff81879-9cc7-46c5-824f-661a525a56bd, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:14:55.576191 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.646552 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] For port 6ff81879-9cc7-46c5-824f-661a525a56bd, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:14:55.649945 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] For port 6ff81879-9cc7-46c5-824f-661a525a56bd, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=6ff81879-9cc7-46c5-824f-661a525a56bd,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:14:55.692398 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.695945 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1888201214-network', 'tenant_id': '907128185ff9473381be53050d202838'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:14:55.716042 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.725859 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.793806 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d436ad14-5d4e-4cf9-98f0-e6ed85d03f70 None None] Pushing event updated for resources: {'Port': ['ID=6ff81879-9cc7-46c5-824f-661a525a56bd,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:55.817408 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Made reservation on behalf of 907128185ff9473381be53050d202838 for: {'network': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:14:55.820921 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.826477 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Allocated IP 172.27.3.172 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/9e2fce9e-f633-4191-bef6-3f55624776ad) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:14:55.844092 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.952944 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:55.954982 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:56.045527 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:56.071060 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1216} {{(pid=103244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:14:56.080600 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5df4ff95-0bc3-4454-a779-cc479e6904a1,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:56.127149 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:56.127149 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.segments_db [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Added segment 79007d98-8337-4c9d-b362-284f4dc6590e of type vlan for network d9d87ca8-7863-48a6-937c-ee712996776e Nov 24 11:14:56.143909 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:56.170328 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:56.210336 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Pushing event updated for resources: {'Port': ['ID=9e2fce9e-f633-4191-bef6-3f55624776ad,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:56.224247 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:56.224597 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:56.225301 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:56.225641 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:56.225968 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:56.226484 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:56.226819 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:56.227662 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:56.227997 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:56.228321 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:56.228639 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:56.228956 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Tracked resource versions report: Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: pushed versions: Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: { 'AddressGroup': {'1.2'}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'ConntrackHelper': {'1.0'}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Log': {'1.0'}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Network': {'1.1'}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Port': {'1.7'}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'PortForwarding': {'1.2'}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'QosPolicy': {'1.10'}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'SecurityGroup': {'1.5'}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'SecurityGroupRule': {'1.2'}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'SubPort': {'1.0'}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Subnet': {'1.1'}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Trunk': {'1.1'}} Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: consumer versions: Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: { DHCP agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: HyperV agent@hv-cinder-80403: {}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: L3 agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: Metadata agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: Metering agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: Open vSwitch agent@dv-cinder-804035-18-iscsi: { 'AddressGroup': '1.2', Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'ConntrackHelper': '1.0', Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Log': '1.0', Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Network': '1.1', Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Port': '1.7', Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'PortForwarding': '1.2', Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'QosPolicy': '1.10', Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'SecurityGroup': '1.5', Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'SecurityGroupRule': '1.2', Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'SubPort': '1.0', Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Subnet': '1.1', Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: 'Trunk': '1.1'}} Nov 24 11:14:56.230117 dv-cinder-804035-18-iscsi neutron-server[103243]: {{(pid=103243) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 11:14:56.239619 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:14:56.241157 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:14:56.246643 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:14:56.284792 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:56.286597 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:14:56.287410 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:56.352174 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] Pushing event updated for resources: {'Network': ['ID=d9d87ca8-7863-48a6-937c-ee712996776e,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:56.362052 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network d9d87ca8-7863-48a6-937c-ee712996776e details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:14:56.431361 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-62babbf9-10b4-44da-9830-51fb3b65b706 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.1158731 Nov 24 11:14:56.438642 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52234) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:14:56.443807 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-56c16e2b-c3e2-441c-909f-258a1de6140f admin admin] Request body: {'subnet': {'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1888201214-subnet', 'tenant_id': '907128185ff9473381be53050d202838', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:14:56.501378 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52238) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:14:56.537313 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-56c16e2b-c3e2-441c-909f-258a1de6140f admin admin] Made reservation on behalf of 907128185ff9473381be53050d202838 for: {'subnet': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:14:56.540378 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:56.542246 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-56c16e2b-c3e2-441c-909f-258a1de6140f admin admin] Publish callbacks [] for subnet, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:56.830935 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1009813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-942685'] for router, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:56.835451 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 6ff81879-9cc7-46c5-824f-661a525a56bd up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:14:56.856733 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-56c16e2b-c3e2-441c-909f-258a1de6140f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for subnet, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:56.927995 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56c16e2b-c3e2-441c-909f-258a1de6140f admin admin] Pushing event updated for resources: {'Subnet': ['ID=c0d420cf-0b8e-4f90-a25c-9a74e1eafabb,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:56.929842 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52248) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:14:56.949544 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 6ff81879-9cc7-46c5-824f-661a525a56bd triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:14:56.949821 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:56.953163 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-56c16e2b-c3e2-441c-909f-258a1de6140f admin admin] Checking segment: {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:14:56.953163 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56c16e2b-c3e2-441c-909f-258a1de6140f admin admin] Network hostable DHCP agents. Network: d9d87ca8-7863-48a6-937c-ee712996776e, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:14:57.039435 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-56c16e2b-c3e2-441c-909f-258a1de6140f admin admin] Network d9d87ca8-7863-48a6-937c-ee712996776e is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:14:57.077691 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1983357343-network', 'tenant_id': '1b97c43049d94ba3b99a111a9b91864d'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:14:57.100346 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36cba3e0-066d-4979-87d5-38f7e15a276c None None] Network 76fcee22-81e5-4608-a546-3b68c56c5ac7 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:14:57.104074 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.120164 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-56c16e2b-c3e2-441c-909f-258a1de6140f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, d9d87ca8-7863-48a6-937c-ee712996776e) {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:14:57.126735 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-56c16e2b-c3e2-441c-909f-258a1de6140f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:14:57.128985 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-56c16e2b-c3e2-441c-909f-258a1de6140f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.132072 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f3bb7f29-6e3b-409a-8ffd-9674e4fcee92 None None] Network d9d87ca8-7863-48a6-937c-ee712996776e requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:14:57.205651 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Made reservation on behalf of 1b97c43049d94ba3b99a111a9b91864d for: {'network': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:14:57.208650 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.223345 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.277556 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] For port 6ff81879-9cc7-46c5-824f-661a525a56bd, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=6ff81879-9cc7-46c5-824f-661a525a56bd,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:14:57.305473 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-56c16e2b-c3e2-441c-909f-258a1de6140f admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.8656735 Nov 24 11:14:57.308278 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52264) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:14:57.314987 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:14:57.327427 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-06c92465-2911-4e2b-bfb5-f50e8f850298 None None] Provisioning complete for port 6ff81879-9cc7-46c5-824f-661a525a56bd triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:14:57.327833 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-06c92465-2911-4e2b-bfb5-f50e8f850298 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.329490 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.353788 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Router 7bb4df85-5735-4ea8-9136-d2387a677310 is scheduled to L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 with binding_index 1 {{(pid=103243) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 11:14:57.424025 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.442524 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1209} {{(pid=103244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:14:57.468489 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.470625 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.segments_db [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Added segment 6c194338-e70c-49da-8985-8d59db407c63 of type vlan for network 86e5ef24-6f2b-4928-b692-ecb9fd8c0b23 Nov 24 11:14:57.516830 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.521930 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1361431959-network', 'tenant_id': 'fae8312f669b48b797904792401edfa4'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:14:57.530863 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.562648 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1010094', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.565488 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1009794', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-534758', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-985777', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-654'] for router, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.578934 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:14:57.593705 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Sync routers for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:14:57.605138 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:14:57.605845 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:14:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:14:57.645959 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Made reservation on behalf of fae8312f669b48b797904792401edfa4 for: {'network': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:14:57.648594 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.665921 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.670391 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.671703 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:14:57.672598 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.806102 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1e1181f3-c521-552f-a8c5-b0ec988a193c-d9d87ca8-7863-48a6-937c-ee712996776e', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb'}]}} from dv-cinder-804035-18-iscsi. {{(pid=103245) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 11:14:57.806985 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.822412 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Pushing event updated for resources: {'Port': ['ID=6ff81879-9cc7-46c5-824f-661a525a56bd,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:57.826132 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b89c6fa0-e54d-48e4-be18-454c74244462,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:57.835483 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] Publish callbacks [] for router, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.842471 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-086c0f4d-28ad-435b-a37c-237db1b74e07 admin admin] 10.222.0.76 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 2.8369417 Nov 24 11:14:57.850151 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52290) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:14:57.856485 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.895036 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:57.915493 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] Pushing event updated for resources: {'Network': ['ID=86e5ef24-6f2b-4928-b692-ecb9fd8c0b23,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:57.945215 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 86e5ef24-6f2b-4928-b692-ecb9fd8c0b23 details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:14:57.982531 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:58.054185 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:14:58.080312 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:14:58.096015 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1227} {{(pid=103243) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:14:58.190047 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:58.190381 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.segments_db [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Added segment 66147b3f-41b0-4ec8-96ba-af958618b639 of type vlan for network 8558262b-7125-4688-a6ea-2f1d2c3b2876 Nov 24 11:14:58.225164 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a63121b3-63c6-430a-b698-5e13ca890eba,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:58.276574 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.db_base_plugin_common [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Allocated IP 172.20.0.2 (d9d87ca8-7863-48a6-937c-ee712996776e/c0d420cf-0b8e-4f90-a25c-9a74e1eafabb/a31debe2-2770-4881-bff9-df26c1e9bb50) {{(pid=103245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:14:58.277851 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-d3d47856-cc70-4aed-9034-876ea10e9b28 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 1.7749469 Nov 24 11:14:58.314417 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52302) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:14:58.323778 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-b8a78b0c-39c1-4756-96f2-6ea41a9ec795 admin admin] Request body: {'subnet': {'network_id': '86e5ef24-6f2b-4928-b692-ecb9fd8c0b23', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1983357343-subnet', 'tenant_id': '1b97c43049d94ba3b99a111a9b91864d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:14:58.328042 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:58.520877 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:58.521629 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:14:56Z', 'revision_number': 3, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:14:55Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:14:58.569722 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Checking router: 7bb4df85-5735-4ea8-9136-d2387a677310 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:14:58.570281 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Updating router 7bb4df85-5735-4ea8-9136-d2387a677310 port 9e2fce9e-f633-4191-bef6-3f55624776ad binding host dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:14:58.591475 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b8a78b0c-39c1-4756-96f2-6ea41a9ec795 admin admin] Made reservation on behalf of 1b97c43049d94ba3b99a111a9b91864d for: {'subnet': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:14:58.593872 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-b8a78b0c-39c1-4756-96f2-6ea41a9ec795 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:58.599989 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-3d5c7bf2-edb3-4951-8fbc-5008e6b6547b None None] Provisioning complete for port 6ff81879-9cc7-46c5-824f-661a525a56bd triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:14:58.608577 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-3d5c7bf2-edb3-4951-8fbc-5008e6b6547b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:58.633384 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:58.700112 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Publish callbacks [] for port, precommit_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:58.797295 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:58.802369 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 6ff81879-9cc7-46c5-824f-661a525a56bd up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:14:58.826984 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:58.856704 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:58.912121 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Pushing event updated for resources: {'Port': ['ID=a31debe2-2770-4881-bff9-df26c1e9bb50,revision_number=1']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:58.936142 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Network d9d87ca8-7863-48a6-937c-ee712996776e is already hosted by enough agents. {{(pid=103245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:14:58.941737 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.base_scheduler [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Resources bound (agent type, host, resource id): {{(pid=103245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:14:58.948128 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Received port after_create {{(pid=103245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:14:59.023867 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Attempting to bind port a31debe2-2770-4881-bff9-df26c1e9bb50 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:14:59.024413 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Attempting to bind port a31debe2-2770-4881-bff9-df26c1e9bb50 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:14:59.025139 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Attempting to bind port a31debe2-2770-4881-bff9-df26c1e9bb50 on network d9d87ca8-7863-48a6-937c-ee712996776e {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:14:59.034408 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 14, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:14:59.035319 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Checking segment: {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:14:59.035729 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.036270 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Bound using segment: {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:14:59.036749 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Bound port: a31debe2-2770-4881-bff9-df26c1e9bb50, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:14:59.037157 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.092287 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.093233 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:14:59.093377 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 6ff81879-9cc7-46c5-824f-661a525a56bd triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:14:59.093703 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.093810 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.167341 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] Pushing event updated for resources: {'Network': ['ID=8558262b-7125-4688-a6ea-2f1d2c3b2876,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:59.197306 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 8558262b-7125-4688-a6ea-2f1d2c3b2876 details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:14:59.243017 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Publish callbacks [] for port, precommit_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.282410 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-b8a78b0c-39c1-4756-96f2-6ea41a9ec795 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for subnet, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.342196 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] For port a31debe2-2770-4881-bff9-df26c1e9bb50, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:14:59.347536 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] For port a31debe2-2770-4881-bff9-df26c1e9bb50, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a31debe2-2770-4881-bff9-df26c1e9bb50,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:14:59.352055 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52350) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:14:59.352593 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-d3a54c50-e4a7-425e-9cd9-4721281ed747 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 2.4213827 Nov 24 11:14:59.357711 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-1211f36b-d443-40de-898f-2e5f8ff53930 admin admin] Request body: {'subnet': {'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1361431959-subnet', 'tenant_id': 'fae8312f669b48b797904792401edfa4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:14:59.377960 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.400850 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a78b0c-39c1-4756-96f2-6ea41a9ec795 admin admin] Pushing event updated for resources: {'Subnet': ['ID=48d293f1-718f-4cda-9b6b-9bfc422e2fdd,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:59.436309 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.451625 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b8a78b0c-39c1-4756-96f2-6ea41a9ec795 admin admin] Checking segment: {'id': '6c194338-e70c-49da-8985-8d59db407c63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1209, 'network_id': '86e5ef24-6f2b-4928-b692-ecb9fd8c0b23'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:14:59.452053 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8a78b0c-39c1-4756-96f2-6ea41a9ec795 admin admin] Network hostable DHCP agents. Network: 86e5ef24-6f2b-4928-b692-ecb9fd8c0b23, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103243) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:14:59.453474 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Pushing event updated for resources: {'Port': ['ID=9e2fce9e-f633-4191-bef6-3f55624776ad,revision_number=2']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:59.464521 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:59.468110 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:59.468110 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:59.468110 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:59.468110 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:59.468110 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:59.468696 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:59.469183 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:59.469813 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:59.470307 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:59.471025 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:59.471527 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Tracked resource versions report: Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: pushed versions: Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: { 'AddressGroup': {'1.2'}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'ConntrackHelper': {'1.0'}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Log': {'1.0'}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Network': {'1.1'}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Port': {'1.7'}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'PortForwarding': {'1.2'}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'QosPolicy': {'1.10'}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'SecurityGroup': {'1.5'}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'SecurityGroupRule': {'1.2'}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'SubPort': {'1.0'}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Subnet': {'1.1'}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Trunk': {'1.1'}} Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: consumer versions: Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: { DHCP agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: HyperV agent@hv-cinder-80403: {}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: L3 agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: Metadata agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: Metering agent@dv-cinder-804035-18-iscsi: {}, Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: Open vSwitch agent@dv-cinder-804035-18-iscsi: { 'AddressGroup': '1.2', Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'ConntrackHelper': '1.0', Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Log': '1.0', Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Network': '1.1', Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Port': '1.7', Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'PortForwarding': '1.2', Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'QosPolicy': '1.10', Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'SecurityGroup': '1.5', Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'SecurityGroupRule': '1.2', Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'SubPort': '1.0', Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Subnet': '1.1', Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: 'Trunk': '1.1'}} Nov 24 11:14:59.473411 dv-cinder-804035-18-iscsi neutron-server[103246]: {{(pid=103246) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 24 11:14:59.499956 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Attempting to bind port 9e2fce9e-f633-4191-bef6-3f55624776ad on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:14:59.500654 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Attempting to bind port 9e2fce9e-f633-4191-bef6-3f55624776ad by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:14:59.501211 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Attempting to bind port 9e2fce9e-f633-4191-bef6-3f55624776ad on network fa6231d1-a629-42bc-a091-20035dee3542 {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:14:59.507781 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 14, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:14:59.508532 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Checking segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:14:59.509135 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.509740 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Bound using segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:14:59.510472 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Bound port: 9e2fce9e-f633-4191-bef6-3f55624776ad, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:14:59.511167 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.531024 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1211f36b-d443-40de-898f-2e5f8ff53930 admin admin] Made reservation on behalf of fae8312f669b48b797904792401edfa4 for: {'subnet': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:14:59.533452 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1211f36b-d443-40de-898f-2e5f8ff53930 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.547968 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b8a78b0c-39c1-4756-96f2-6ea41a9ec795 admin admin] Network 86e5ef24-6f2b-4928-b692-ecb9fd8c0b23 is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103243) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:14:59.577748 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] For port 9e2fce9e-f633-4191-bef6-3f55624776ad, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:14:59.584577 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Allocated IP 172.27.3.212 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/58dbaf25-a351-409e-9cca-b5ab345c35a1) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:14:59.584928 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] For port 9e2fce9e-f633-4191-bef6-3f55624776ad, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9e2fce9e-f633-4191-bef6-3f55624776ad,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:14:59.630075 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d20064fd-966b-4f83-8971-9d880a86eaa8 None None] Pushing event updated for resources: {'Port': ['ID=a31debe2-2770-4881-bff9-df26c1e9bb50,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:59.641672 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-b8a78b0c-39c1-4756-96f2-6ea41a9ec795 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 86e5ef24-6f2b-4928-b692-ecb9fd8c0b23) {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:14:59.648315 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.652006 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b8a78b0c-39c1-4756-96f2-6ea41a9ec795 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:14:59.652683 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-b8a78b0c-39c1-4756-96f2-6ea41a9ec795 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.656773 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.667531 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c76fa73d-5fa2-49a7-ba28-edc873644d6b None None] Network 86e5ef24-6f2b-4928-b692-ecb9fd8c0b23 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:14:59.747185 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:14:59.749732 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:14:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:14:59.760181 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6751b15-5ebf-4b5f-8361-bbfa84f56807 None None] Pushing event updated for resources: {'Port': ['ID=9e2fce9e-f633-4191-bef6-3f55624776ad,revision_number=3']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:14:59.814542 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-b8a78b0c-39c1-4756-96f2-6ea41a9ec795 admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.4849889 Nov 24 11:14:59.887680 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0efcb702-865b-4a72-9662-90c436189874 None None] Network 86e5ef24-6f2b-4928-b692-ecb9fd8c0b23 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:14:59.902817 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:14:59.967545 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:15:00.022964 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Allocated IP 172.20.0.1 (76fcee22-81e5-4608-a546-3b68c56c5ac7/5eae2e87-935a-45b7-89da-586ce04ad644/1b6f5e32-07ed-47f9-a43d-ab92febf678e) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:15:00.216884 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:14:56Z', 'revision_number': 3, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:14:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:00.236370 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:00.247998 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cc389eab-44a0-4977-82ff-ed0df4f5a863 None None] The sync data for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi is: [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:14:56Z', 'revision_number': 3, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:14:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:15:00.354059 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1211f36b-d443-40de-898f-2e5f8ff53930 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for subnet, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:00.382990 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:00.403349 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:00.443609 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Network 76fcee22-81e5-4608-a546-3b68c56c5ac7 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:15:00.450678 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:15:00.457694 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:15:00.462857 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1009482'] for router_interface, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:00.542966 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1211f36b-d443-40de-898f-2e5f8ff53930 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cd868cb4-b7fb-4350-b027-a21baabac768,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:00.560787 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:15:00.570480 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:15:00.585924 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:15:00.591777 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Pushing event updated for resources: {'Port': ['ID=58dbaf25-a351-409e-9cca-b5ab345c35a1,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:00.730748 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1211f36b-d443-40de-898f-2e5f8ff53930 admin admin] Checking segment: {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:15:00.731367 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1211f36b-d443-40de-898f-2e5f8ff53930 admin admin] Network hostable DHCP agents. Network: 8558262b-7125-4688-a6ea-2f1d2c3b2876, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:15:00.834327 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Pushing event updated for resources: {'Port': ['ID=1b6f5e32-07ed-47f9-a43d-ab92febf678e,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:01.130822 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:01.143740 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9e2fce9e-f633-4191-bef6-3f55624776ad up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:15:01.144868 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1211f36b-d443-40de-898f-2e5f8ff53930 admin admin] Network 8558262b-7125-4688-a6ea-2f1d2c3b2876 is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:15:01.165492 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52410) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:01.180937 dv-cinder-804035-18-iscsi neutron-server[103244]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 24 11:15:01.292170 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-1211f36b-d443-40de-898f-2e5f8ff53930 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 8558262b-7125-4688-a6ea-2f1d2c3b2876) {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:15:01.292372 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-a2e9deec-51fd-4d4a-ad33-4774cfa29cab None None] Provisioning complete for port 1b6f5e32-07ed-47f9-a43d-ab92febf678e triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:01.292372 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-a2e9deec-51fd-4d4a-ad33-4774cfa29cab None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:01.304033 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c962c5b-4b25-44f5-a1ea-17f49f1e8e42 None None] Network 8558262b-7125-4688-a6ea-2f1d2c3b2876 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:15:01.386462 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1211f36b-d443-40de-898f-2e5f8ff53930 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:01.389460 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1211f36b-d443-40de-898f-2e5f8ff53930 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:01.468436 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-a2e9deec-51fd-4d4a-ad33-4774cfa29cab None None] Port 1b6f5e32-07ed-47f9-a43d-ab92febf678e cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:15:01.477862 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e915e003-1d62-438b-9a5d-b606f7b5c339 None None] Network d9d87ca8-7863-48a6-937c-ee712996776e requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:15:01.502959 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 9e2fce9e-f633-4191-bef6-3f55624776ad triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:01.504009 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:01.529317 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:01.605337 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-1211f36b-d443-40de-898f-2e5f8ff53930 admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 2.2521524 Nov 24 11:15:01.639669 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:01.642635 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-636370', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1009638'] for router_interface, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:01.656987 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-f9b227c4-0aff-4312-ab28-599015138ad0 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:01.658487 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-f9b227c4-0aff-4312-ab28-599015138ad0 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/networks?id=86e5ef24-6f2b-4928-b692-ecb9fd8c0b23 HTTP/1.1" status: 200 len: 812 time: 0.4825087 Nov 24 11:15:01.683467 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:01.690226 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-aab13327-4003-43bc-a753-671a3c4dbd69 None None] Provisioning complete for port a31debe2-2770-4881-bff9-df26c1e9bb50 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:01.690596 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-aab13327-4003-43bc-a753-671a3c4dbd69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:01.694358 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-cec7a4a2-c04a-4c3b-97a6-cf629ee6d8ae tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/quotas/1b97c43049d94ba3b99a111a9b91864d HTTP/1.1" status: 200 len: 375 time: 0.0269632 Nov 24 11:15:01.721458 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3571e734-8fe8-4da4-8ae5-220fd5ca05bd None None] Network 8558262b-7125-4688-a6ea-2f1d2c3b2876 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:15:01.798755 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-fcbcc2eb-8864-416f-b0dd-76a4f7e5fef6 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=1b97c43049d94ba3b99a111a9b91864d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1030121 Nov 24 11:15:01.935133 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Pushing event updated for resources: {'Port': ['ID=1b6f5e32-07ed-47f9-a43d-ab92febf678e,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:01.988854 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:02.054846 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] For port 9e2fce9e-f633-4191-bef6-3f55624776ad, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9e2fce9e-f633-4191-bef6-3f55624776ad,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:02.093290 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Network 76fcee22-81e5-4608-a546-3b68c56c5ac7 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:15:02.095421 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:15:02.122336 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1009813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-942685'] for router, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:02.184305 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52436) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:02.187070 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:02.188504 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a31debe2-2770-4881-bff9-df26c1e9bb50 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:15:02.217422 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52440) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:02.378379 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Pushing event updated for resources: {'Port': ['ID=9e2fce9e-f633-4191-bef6-3f55624776ad,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:02.388300 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-aab13327-4003-43bc-a753-671a3c4dbd69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:02.442093 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Router 7bb4df85-5735-4ea8-9136-d2387a677310 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:15:02.490034 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-aab13327-4003-43bc-a753-671a3c4dbd69 None None] For port a31debe2-2770-4881-bff9-df26c1e9bb50, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a31debe2-2770-4881-bff9-df26c1e9bb50,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:02.519823 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port a31debe2-2770-4881-bff9-df26c1e9bb50 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:02.523325 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:02.572605 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-aab13327-4003-43bc-a753-671a3c4dbd69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:02.605058 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 is scheduled to L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 with binding_index 1 {{(pid=103244) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 11:15:02.662738 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ff08d615-dc35-410a-952f-dfe12ddd1fe6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:02.675735 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aab13327-4003-43bc-a753-671a3c4dbd69 None None] Pushing event updated for resources: {'Port': ['ID=a31debe2-2770-4881-bff9-df26c1e9bb50,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:02.724988 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:15:02.744278 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-d24eb774-907a-4637-a568-28c05118060a admin admin] 10.222.0.76 "PUT /v2.0/routers/7bb4df85-5735-4ea8-9136-d2387a677310/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8847570 Nov 24 11:15:02.779832 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-2bf79a5a-9dfa-4a0c-bfc1-822a6901b207 None None] Provisioning complete for port 1b6f5e32-07ed-47f9-a43d-ab92febf678e triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:02.780205 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-2bf79a5a-9dfa-4a0c-bfc1-822a6901b207 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:02.846973 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ff08d615-dc35-410a-952f-dfe12ddd1fe6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:02.851780 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-2bf79a5a-9dfa-4a0c-bfc1-822a6901b207 None None] Port 1b6f5e32-07ed-47f9-a43d-ab92febf678e cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:15:02.864466 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-2bf79a5a-9dfa-4a0c-bfc1-822a6901b207 None None] Provisioning complete for port a31debe2-2770-4881-bff9-df26c1e9bb50 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:02.865005 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-2bf79a5a-9dfa-4a0c-bfc1-822a6901b207 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:02.883303 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-60824ed2-2914-4ff2-9d68-b928cd78ca3d service neutron] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:15:02.883303 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-60824ed2-2914-4ff2-9d68-b928cd78ca3d service neutron] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.4113717 Nov 24 11:15:02.975654 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:15:02.985088 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Sync routers for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:15:02.986872 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ff08d615-dc35-410a-952f-dfe12ddd1fe6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:02.999046 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9e2fce9e-f633-4191-bef6-3f55624776ad up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:15:02.999563 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:15:03.000352 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:14:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:03.010684 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Sync routers for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:15:03.015533 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-41527b49-1e63-4b1c-b8d2-aca2df023543 service neutron] 10.222.0.76 "GET /v2.0/networks/86e5ef24-6f2b-4928-b692-ecb9fd8c0b23?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1280837 Nov 24 11:15:03.033696 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fa93e7b4-246a-4363-93f0-3c76a6609fbd admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:03.078447 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:15:03.080521 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:14:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:03.108764 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] Publish callbacks [] for router, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:03.116007 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2d64f6cb-4515-4183-904c-4813a633f735 admin admin] 10.222.0.76 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 5.8029807 Nov 24 11:15:03.116230 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff08d615-dc35-410a-952f-dfe12ddd1fe6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8bce4e40-e5e2-4187-81b3-8e2551488099,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:03.116230 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52462) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:03.122784 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-ff08d615-dc35-410a-952f-dfe12ddd1fe6 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=6603c818388449b9b4e35fadb6e5fde5&name=default HTTP/1.1" status: 200 len: 2992 time: 0.9373851 Nov 24 11:15:03.128434 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52464) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:03.163819 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:15:03.194067 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-f5b2fbf1-e0cb-4251-b48e-29a4c74c7572 service neutron] 10.222.0.76 "GET /v2.0/networks/86e5ef24-6f2b-4928-b692-ecb9fd8c0b23?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1634901 Nov 24 11:15:03.299959 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 9e2fce9e-f633-4191-bef6-3f55624776ad triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:03.299959 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:03.360498 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a7f508e4-c55c-420b-bbe7-120af91f5b87 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:03.391238 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fa93e7b4-246a-4363-93f0-3c76a6609fbd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:03.416673 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 3, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:14:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:03.434182 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:15:03.434587 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a7f508e4-c55c-420b-bbe7-120af91f5b87 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:03.448421 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Checking router: 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:15:03.449346 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Updating router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 port 58dbaf25-a351-409e-9cca-b5ab345c35a1 binding host dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:15:03.498270 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:03.517541 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fa93e7b4-246a-4363-93f0-3c76a6609fbd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:03.618389 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-fa93e7b4-246a-4363-93f0-3c76a6609fbd admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=2ff9efe0cd884e9fba4a83762dd2dcf0&name=default HTTP/1.1" status: 200 len: 2992 time: 1.3998668 Nov 24 11:15:03.620127 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52486) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:03.623384 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa93e7b4-246a-4363-93f0-3c76a6609fbd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e03371f5-28f0-476c-ab75-ed2b8c872545,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:03.813995 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a31debe2-2770-4881-bff9-df26c1e9bb50 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:15:03.820978 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-86b4e1a6-e0bc-4d87-a9f8-c7a90c4c286f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:03.860257 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-86b4e1a6-e0bc-4d87-a9f8-c7a90c4c286f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:03.906300 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52510) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:03.945973 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a7f508e4-c55c-420b-bbe7-120af91f5b87 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:03.948713 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a7f508e4-c55c-420b-bbe7-120af91f5b87 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:03.955525 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-a7f508e4-c55c-420b-bbe7-120af91f5b87 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/8bce4e40-e5e2-4187-81b3-8e2551488099 HTTP/1.1" status: 204 len: 168 time: 0.8234782 Nov 24 11:15:03.999335 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7f508e4-c55c-420b-bbe7-120af91f5b87 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8bce4e40-e5e2-4187-81b3-8e2551488099,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:04.026046 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port a31debe2-2770-4881-bff9-df26c1e9bb50 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:04.026417 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.080716 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Publish callbacks [] for port, precommit_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.124468 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-e095436e-40a3-4012-8384-af0158f74330 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:04.135630 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-e095436e-40a3-4012-8384-af0158f74330 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/networks?id=8558262b-7125-4688-a6ea-2f1d2c3b2876 HTTP/1.1" status: 200 len: 815 time: 0.2277284 Nov 24 11:15:04.154927 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-dbf7e558-7c71-4b67-9373-aeeda558472a tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/quotas/fae8312f669b48b797904792401edfa4 HTTP/1.1" status: 200 len: 375 time: 0.0183587 Nov 24 11:15:04.173828 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52514) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:04.179412 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-e336df25-1845-47ac-bb9e-833fcca77c5a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1225008807', 'description': 'tempest-description--1588938039'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:04.210172 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.216370 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.256757 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-9c6c11a6-4b1f-44cd-8607-c95fe0d7467c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1006777 Nov 24 11:15:04.307803 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Attempting to bind port 58dbaf25-a351-409e-9cca-b5ab345c35a1 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:15:04.308459 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Attempting to bind port 58dbaf25-a351-409e-9cca-b5ab345c35a1 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:15:04.309184 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Attempting to bind port 58dbaf25-a351-409e-9cca-b5ab345c35a1 on network fa6231d1-a629-42bc-a091-20035dee3542 {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:15:04.313226 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ab83d5-dfd2-48bf-bed6-2a264d6dd4ed None None] Pushing event updated for resources: {'Port': ['ID=58dbaf25-a351-409e-9cca-b5ab345c35a1,revision_number=2']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:04.326754 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 14, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:15:04.328126 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Checking segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:15:04.329468 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.332043 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Bound using segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:15:04.332747 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Bound port: 58dbaf25-a351-409e-9cca-b5ab345c35a1, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:15:04.333339 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.335458 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e336df25-1845-47ac-bb9e-833fcca77c5a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.337444 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-86b4e1a6-e0bc-4d87-a9f8-c7a90c4c286f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.337843 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 2, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:04.340203 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-86b4e1a6-e0bc-4d87-a9f8-c7a90c4c286f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.342421 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-86b4e1a6-e0bc-4d87-a9f8-c7a90c4c286f admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/e03371f5-28f0-476c-ab75-ed2b8c872545 HTTP/1.1" status: 204 len: 168 time: 0.7094512 Nov 24 11:15:04.377294 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86b4e1a6-e0bc-4d87-a9f8-c7a90c4c286f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e03371f5-28f0-476c-ab75-ed2b8c872545,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:04.377788 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Checking router: 7bb4df85-5735-4ea8-9136-d2387a677310 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:15:04.378773 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Updating router 7bb4df85-5735-4ea8-9136-d2387a677310 port 1b6f5e32-07ed-47f9-a43d-ab92febf678e binding host dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:15:04.391937 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-09ec9d62-920d-48d9-936c-3457e2589e83 req-4a21b144-dfca-4f02-8f72-ff22a11ffd32 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 210 time: 0.0888138 Nov 24 11:15:04.477523 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52532) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:04.484701 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] For port 58dbaf25-a351-409e-9cca-b5ab345c35a1, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:15:04.493824 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] For port 58dbaf25-a351-409e-9cca-b5ab345c35a1, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=58dbaf25-a351-409e-9cca-b5ab345c35a1,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:15:04.546783 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.590615 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.614302 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Allocated IP 172.20.0.1 (d9d87ca8-7863-48a6-937c-ee712996776e/c0d420cf-0b8e-4f90-a25c-9a74e1eafabb/19717b1c-5b56-45d5-911e-2c1406e74b2b) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:15:04.625700 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e336df25-1845-47ac-bb9e-833fcca77c5a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.693512 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:15:04.694142 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:14:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:04.702473 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e336df25-1845-47ac-bb9e-833fcca77c5a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.756921 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e336df25-1845-47ac-bb9e-833fcca77c5a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event updated for resources: {'SecurityGroup': ['ID=88c1dfcd-809d-471e-ae01-5627ef698662,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:04.809567 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6d087102-adf3-40ee-b84d-3bc74323be02 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.814856 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34ab83d5-dfd2-48bf-bed6-2a264d6dd4ed None None] Pushing event updated for resources: {'Port': ['ID=58dbaf25-a351-409e-9cca-b5ab345c35a1,revision_number=3']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:04.827431 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e336df25-1845-47ac-bb9e-833fcca77c5a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.827431 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-e336df25-1845-47ac-bb9e-833fcca77c5a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.6496201 Nov 24 11:15:04.828705 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52556) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:04.837034 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-e1381f67-bbf3-4cb4-9327-aef9c7f129e6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Request body: {'security_group_rule': {'security_group_id': '88c1dfcd-809d-471e-ae01-5627ef698662', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:04.900664 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:04.929219 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:15:04.970196 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e1381f67-bbf3-4cb4-9327-aef9c7f129e6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.038370 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Publish callbacks [] for port, precommit_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.059640 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6d087102-adf3-40ee-b84d-3bc74323be02 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.413875 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e1381f67-bbf3-4cb4-9327-aef9c7f129e6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.413875 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-aa07db80-8856-40d3-b7a2-7751423aa418 service neutron] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:15:05.413875 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-aa07db80-8856-40d3-b7a2-7751423aa418 service neutron] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.4178278 Nov 24 11:15:05.417155 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.418094 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 3, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:05.424754 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Network d9d87ca8-7863-48a6-937c-ee712996776e is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:15:05.424754 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:15:05.424754 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:15:05.424754 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1009482'] for router_interface, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.425669 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-051ab6fc-1ba7-457a-b55a-f2fa725820b7 None None] The sync data for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi is: [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 3, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:15:05.425979 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-9d685226-ffbe-49b1-a4d8-f1e61ad297eb service neutron] 10.222.0.76 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1104026 Nov 24 11:15:05.426320 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Pushing event updated for resources: {'Port': ['ID=19717b1c-5b56-45d5-911e-2c1406e74b2b,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:05.426682 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.427272 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6d087102-adf3-40ee-b84d-3bc74323be02 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.428759 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e1381f67-bbf3-4cb4-9327-aef9c7f129e6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.428759 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1381f67-bbf3-4cb4-9327-aef9c7f129e6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1e9893dc-8b08-41dd-8d13-08d8acfabc15,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:05.428759 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-51527cb3-f20d-4490-ba95-fd8149a1cec5 service neutron] 10.222.0.76 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1372244 Nov 24 11:15:05.429051 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-6d087102-adf3-40ee-b84d-3bc74323be02 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=dc9db7af3a544d8bad4d5d48c5f1b587&name=default HTTP/1.1" status: 200 len: 2992 time: 0.9338584 Nov 24 11:15:05.429150 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52570) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:05.429245 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d087102-adf3-40ee-b84d-3bc74323be02 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=424b79b2-0843-44d2-8ab4-1964fef046a8,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:05.453623 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b0efde0-0796-40d1-90d0-af34136f0f0a None None] Pushing event updated for resources: {'Port': ['ID=1b6f5e32-07ed-47f9-a43d-ab92febf678e,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:05.555978 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e1381f67-bbf3-4cb4-9327-aef9c7f129e6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.559480 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-e1381f67-bbf3-4cb4-9327-aef9c7f129e6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7275124 Nov 24 11:15:05.563954 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52574) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:05.588383 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Attempting to bind port 1b6f5e32-07ed-47f9-a43d-ab92febf678e on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:15:05.588844 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Attempting to bind port 1b6f5e32-07ed-47f9-a43d-ab92febf678e by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:15:05.594553 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Attempting to bind port 1b6f5e32-07ed-47f9-a43d-ab92febf678e on network 76fcee22-81e5-4608-a546-3b68c56c5ac7 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:15:05.601110 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 14, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:15:05.601593 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Checking segment: {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:15:05.602072 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.602649 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.602751 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Bound using segment: {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:15:05.603236 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Bound port: 1b6f5e32-07ed-47f9-a43d-ab92febf678e, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:15:05.604001 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.619413 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dadd17f3-9267-4e08-ad07-7d958c72d12a req-a8508465-eb9c-4b5a-a638-9a0e817a7873 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 210 time: 0.0663912 Nov 24 11:15:05.635536 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-2c703a18-39b8-49eb-843e-2cbbb094af06 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Request body: {'security_group_rule': {'security_group_id': '88c1dfcd-809d-471e-ae01-5627ef698662', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:05.640346 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52576) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:05.762278 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d145564e-ec9b-4f6a-9a37-c589856cc6e3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.765807 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-bf4b595e-6f21-4890-8e0d-19d1143fdf97 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.825826 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-bf4b595e-6f21-4890-8e0d-19d1143fdf97 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.923032 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-821e07b1-8fda-4966-a137-d419dd8cb941 None None] Provisioning complete for port 19717b1c-5b56-45d5-911e-2c1406e74b2b triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:05.923392 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-821e07b1-8fda-4966-a137-d419dd8cb941 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:05.972446 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] For port 1b6f5e32-07ed-47f9-a43d-ab92febf678e, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:15:05.977474 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] For port 1b6f5e32-07ed-47f9-a43d-ab92febf678e, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=1b6f5e32-07ed-47f9-a43d-ab92febf678e,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:15:05.980176 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-821e07b1-8fda-4966-a137-d419dd8cb941 None None] Port 19717b1c-5b56-45d5-911e-2c1406e74b2b cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:15:06.013888 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d145564e-ec9b-4f6a-9a37-c589856cc6e3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.033813 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.099894 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-74ccbe27-2f21-4733-aaf0-5f53b494842f None None] Provisioning complete for port 1b6f5e32-07ed-47f9-a43d-ab92febf678e triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:06.100266 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-74ccbe27-2f21-4733-aaf0-5f53b494842f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.139115 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-74ccbe27-2f21-4733-aaf0-5f53b494842f None None] Port 1b6f5e32-07ed-47f9-a43d-ab92febf678e cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:15:06.171141 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d145564e-ec9b-4f6a-9a37-c589856cc6e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.171759 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.175382 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.175963 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-636370', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1009638'] for router_interface, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.182608 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-bf4b595e-6f21-4890-8e0d-19d1143fdf97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.190270 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-bf4b595e-6f21-4890-8e0d-19d1143fdf97 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.221279 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-bf4b595e-6f21-4890-8e0d-19d1143fdf97 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/424b79b2-0843-44d2-8ab4-1964fef046a8 HTTP/1.1" status: 204 len: 168 time: 0.8044827 Nov 24 11:15:06.241712 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2c703a18-39b8-49eb-843e-2cbbb094af06 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.296795 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf4b595e-6f21-4890-8e0d-19d1143fdf97 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=424b79b2-0843-44d2-8ab4-1964fef046a8,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:06.297770 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d145564e-ec9b-4f6a-9a37-c589856cc6e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d2c02b4-c396-4159-8a62-aaa37c677f90,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:06.323190 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b0efde0-0796-40d1-90d0-af34136f0f0a None None] Pushing event updated for resources: {'Port': ['ID=1b6f5e32-07ed-47f9-a43d-ab92febf678e,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:06.384317 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:15:06.384887 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:14:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:06.529263 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a7665737-81e4-4dc5-a1ad-bb39bea005c9 req-dde8d348-765a-4495-b7be-5256096cbba1 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 210 time: 0.1449976 Nov 24 11:15:06.577685 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-d145564e-ec9b-4f6a-9a37-c589856cc6e3 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=a7f67119c1544519833675c85f4f48a6&name=default HTTP/1.1" status: 200 len: 2992 time: 0.9332895 Nov 24 11:15:06.584017 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52604) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:06.605039 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2c703a18-39b8-49eb-843e-2cbbb094af06 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.611752 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:15:06.620531 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Pushing event updated for resources: {'Port': ['ID=19717b1c-5b56-45d5-911e-2c1406e74b2b,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:06.725790 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2c703a18-39b8-49eb-843e-2cbbb094af06 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.755387 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Network d9d87ca8-7863-48a6-937c-ee712996776e is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:15:06.757198 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:15:06.769864 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-90387b7d-199f-445e-b709-d7722a83f61b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.793305 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c703a18-39b8-49eb-843e-2cbbb094af06 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6492b176-1aad-4331-a6c7-f947c8d38e7e,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:06.837200 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-072498ff-f919-4244-8ca1-c317276a7f32 req-5e51692c-f2ce-4b5e-b48e-e04ab0ffa41d tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 210 time: 0.0744350 Nov 24 11:15:06.887337 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-90387b7d-199f-445e-b709-d7722a83f61b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.901311 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2c703a18-39b8-49eb-843e-2cbbb094af06 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:06.905226 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2c703a18-39b8-49eb-843e-2cbbb094af06 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.3079379 Nov 24 11:15:06.927569 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52620) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:07.012358 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Request body: {'floatingip': {'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:07.134423 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 58dbaf25-a351-409e-9cca-b5ab345c35a1 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:15:07.170319 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-90387b7d-199f-445e-b709-d7722a83f61b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:07.173325 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-90387b7d-199f-445e-b709-d7722a83f61b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:07.178033 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-90387b7d-199f-445e-b709-d7722a83f61b admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/8d2c02b4-c396-4159-8a62-aaa37c677f90 HTTP/1.1" status: 204 len: 168 time: 0.5927112 Nov 24 11:15:07.195031 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90387b7d-199f-445e-b709-d7722a83f61b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d2c02b4-c396-4159-8a62-aaa37c677f90,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:07.262554 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-b9c06aed-3604-4d06-86a4-ef22368ac6f8 None None] Provisioning complete for port 1b6f5e32-07ed-47f9-a43d-ab92febf678e triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:07.262888 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b9c06aed-3604-4d06-86a4-ef22368ac6f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:07.318338 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:15:07.398466 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 58dbaf25-a351-409e-9cca-b5ab345c35a1 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:07.399097 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:07.428950 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:07.479645 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b9c06aed-3604-4d06-86a4-ef22368ac6f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:07.482694 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:07.511502 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:15:07.516890 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-c1f1a5e0-ef31-4983-8131-13d666cc67cf admin admin] 10.222.0.76 "PUT /v2.0/routers/4e3f49a3-6e8d-47c7-ae8a-a127354c4431/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.3995559 Nov 24 11:15:07.530512 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6c089816-b30f-4055-ae41-d5c069526b55 None None] The sync data for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi is: [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:15:07.585816 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-b9c06aed-3604-4d06-86a4-ef22368ac6f8 None None] For port 1b6f5e32-07ed-47f9-a43d-ab92febf678e, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=1b6f5e32-07ed-47f9-a43d-ab92febf678e,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:07.610153 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:07.662661 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b9c06aed-3604-4d06-86a4-ef22368ac6f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:07.666766 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] For port 58dbaf25-a351-409e-9cca-b5ab345c35a1, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=58dbaf25-a351-409e-9cca-b5ab345c35a1,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:07.724161 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2cc660bd-59b3-4a69-bcd6-1b081c18c9c2 req-51a1fbd9-f490-44e4-b85a-27fd628072f6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 210 time: 0.0810964 Nov 24 11:15:07.740251 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9c06aed-3604-4d06-86a4-ef22368ac6f8 None None] Pushing event updated for resources: {'Port': ['ID=1b6f5e32-07ed-47f9-a43d-ab92febf678e,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:07.743771 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:07.753207 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:07.855487 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-b952b266-ab36-4252-a60f-25322b57d086 None None] Provisioning complete for port 19717b1c-5b56-45d5-911e-2c1406e74b2b triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:07.856820 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b952b266-ab36-4252-a60f-25322b57d086 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:07.867040 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52652) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:07.914694 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a2201f04-8678-40b2-a9dd-9eadb2bdf7f4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:07.976841 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Sync routers for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:15:08.012634 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Pushing event updated for resources: {'Port': ['ID=58dbaf25-a351-409e-9cca-b5ab345c35a1,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:08.058617 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:15:08.068702 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:14:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:08.084560 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Allocated IP 172.27.3.239 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/6c699279-7167-474a-a37b-dab7487bbf4b) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:15:08.192139 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a2201f04-8678-40b2-a9dd-9eadb2bdf7f4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:08.297122 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7b955722-9320-482a-9de2-8a1bd583b7c3 req-bee35563-053d-480e-9cc4-7f2bd28cbe79 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 210 time: 0.0852153 Nov 24 11:15:08.297820 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a2201f04-8678-40b2-a9dd-9eadb2bdf7f4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:08.314590 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-b952b266-ab36-4252-a60f-25322b57d086 None None] Port 19717b1c-5b56-45d5-911e-2c1406e74b2b cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:15:08.366295 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:08.389525 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:15:08.424641 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-a2201f04-8678-40b2-a9dd-9eadb2bdf7f4 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=4ac291e125374af9aae3f5dfc68e9191&name=default HTTP/1.1" status: 200 len: 2994 time: 0.5538039 Nov 24 11:15:08.427184 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52676) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:08.432898 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2201f04-8678-40b2-a9dd-9eadb2bdf7f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cad7578e-3d97-4638-b5e6-7c508e43ab66,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:08.555605 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cc0b5b8e-cf2f-4e4b-8400-6297c60c3dbf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:08.590596 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:08.619000 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cc0b5b8e-cf2f-4e4b-8400-6297c60c3dbf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:08.716348 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:15:08.724728 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:15:08.743116 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:15:08.788498 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 2, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:08.891645 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event updated for resources: {'Port': ['ID=6c699279-7167-474a-a37b-dab7487bbf4b,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:08.927608 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-dee1f3d4-2fc5-42ee-b669-094c3ef833d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:08.936432 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Checking router: 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:15:08.936994 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Updating router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 port 19717b1c-5b56-45d5-911e-2c1406e74b2b binding host dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:15:09.026092 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.031548 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ae331b5d-92d2-4440-bb8e-05a8fd6fa966 req-b04f70e5-88e2-4a16-9014-755e4adc36be tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 210 time: 0.0742466 Nov 24 11:15:09.035972 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.86', 56819) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:09.062046 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.193679 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cc0b5b8e-cf2f-4e4b-8400-6297c60c3dbf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.196630 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cc0b5b8e-cf2f-4e4b-8400-6297c60c3dbf admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.198651 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 58dbaf25-a351-409e-9cca-b5ab345c35a1 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:15:09.199148 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-cc0b5b8e-cf2f-4e4b-8400-6297c60c3dbf admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/cad7578e-3d97-4638-b5e6-7c508e43ab66 HTTP/1.1" status: 204 len: 168 time: 0.7708306 Nov 24 11:15:09.224455 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc0b5b8e-cf2f-4e4b-8400-6297c60c3dbf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cad7578e-3d97-4638-b5e6-7c508e43ab66,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:09.263252 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-d2001b47-c01d-4596-b4e4-80b8174e0910 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:09.266569 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-d2001b47-c01d-4596-b4e4-80b8174e0910 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.86 "GET /v2.0/networks?id=86e5ef24-6f2b-4928-b692-ecb9fd8c0b23 HTTP/1.1" status: 200 len: 812 time: 0.2294450 Nov 24 11:15:09.272015 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52704) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:09.287380 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-e6909298-3d2c-42b4-9809-838958c82bde tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1604758842', 'description': 'tempest-description--504552193'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:09.294335 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.310825 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.328884 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Request body: {'port': {'device_id': 'ed7b28e1-4fea-4e73-abbc-496e22238856', 'network_id': '86e5ef24-6f2b-4928-b692-ecb9fd8c0b23', 'admin_state_up': True, 'tenant_id': '1b97c43049d94ba3b99a111a9b91864d'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:09.577342 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.648904 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.672040 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bb1f9d97-8cdf-47c6-af5d-cda97a8460aa req-a4bbfba3-39b3-4841-b71b-af30bb2b8a1c tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 210 time: 0.2004886 Nov 24 11:15:09.676398 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.700537 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6909298-3d2c-42b4-9809-838958c82bde tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.741313 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 58dbaf25-a351-409e-9cca-b5ab345c35a1 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:09.741706 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event updated for resources: {'Port': ['ID=6c699279-7167-474a-a37b-dab7487bbf4b,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:09.742222 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.819415 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.820827 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-0392b53c-c184-4556-b9e7-5b45d74c3487 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.8361707 Nov 24 11:15:09.922929 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6909298-3d2c-42b4-9809-838958c82bde tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:09.959046 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Made reservation on behalf of 1b97c43049d94ba3b99a111a9b91864d for: {'port': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:15:09.962638 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.035571 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 1b6f5e32-07ed-47f9-a43d-ab92febf678e up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:15:10.051466 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6909298-3d2c-42b4-9809-838958c82bde tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.120175 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Publish callbacks [] for port, precommit_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.133800 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 1b6f5e32-07ed-47f9-a43d-ab92febf678e triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:10.135601 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.212720 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f6c9ddbe-3624-4e5a-a7e7-9f9a4ee92abe req-006a976a-ecfb-49bd-a9f8-6c7d7f33635d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 210 time: 0.0963545 Nov 24 11:15:10.221604 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6909298-3d2c-42b4-9809-838958c82bde tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4d84d439-4e42-43d6-9a84-d7924912abec,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:10.272098 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Allocated IP 172.20.0.3 (86e5ef24-6f2b-4928-b692-ecb9fd8c0b23/48d293f1-718f-4cda-9b6b-9bfc422e2fdd/1c0adb45-b280-450a-b0f3-3c1f7c926920) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:15:10.291598 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.307455 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6909298-3d2c-42b4-9809-838958c82bde tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.308936 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-e6909298-3d2c-42b4-9809-838958c82bde tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 1.0343790 Nov 24 11:15:10.311561 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52776) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:10.317079 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-a8d0543d-6c07-4bdf-b005-80612ea0a6f5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Request body: {'security_group_rule': {'security_group_id': '4d84d439-4e42-43d6-9a84-d7924912abec', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:10.389356 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-349da108-c2bd-4ea8-9261-d73e3effa2a2 None None] Pushing event updated for resources: {'Port': ['ID=19717b1c-5b56-45d5-911e-2c1406e74b2b,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:10.455836 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-5ccd806f-f8e6-4ba4-bf5b-84ade91b6e95 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?name=tempest-securitygroup--1225008807&fields=id&tenant_id=70ea7b83799640618db2c87847a8ecea HTTP/1.1" status: 200 len: 267 time: 0.1855175 Nov 24 11:15:10.475878 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Attempting to bind port 19717b1c-5b56-45d5-911e-2c1406e74b2b on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:15:10.476551 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Attempting to bind port 19717b1c-5b56-45d5-911e-2c1406e74b2b by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:15:10.477104 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Attempting to bind port 19717b1c-5b56-45d5-911e-2c1406e74b2b on network d9d87ca8-7863-48a6-937c-ee712996776e {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:15:10.483961 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 14, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:15:10.487172 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Checking segment: {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:15:10.487172 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.487172 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Bound using segment: {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:15:10.495414 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a8d0543d-6c07-4bdf-b005-80612ea0a6f5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.505359 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Bound port: 19717b1c-5b56-45d5-911e-2c1406e74b2b, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:15:10.506246 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.592703 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.86', 56825) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:10.613096 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] For port 19717b1c-5b56-45d5-911e-2c1406e74b2b, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:15:10.618395 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] For port 19717b1c-5b56-45d5-911e-2c1406e74b2b, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=19717b1c-5b56-45d5-911e-2c1406e74b2b,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:15:10.683479 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.763198 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a8d0543d-6c07-4bdf-b005-80612ea0a6f5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.884092 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a8d0543d-6c07-4bdf-b005-80612ea0a6f5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.925770 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-f229c1b7-f5a2-4870-9601-79e70c455855 None None] Provisioning complete for port 19717b1c-5b56-45d5-911e-2c1406e74b2b triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:10.926126 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f229c1b7-f5a2-4870-9601-79e70c455855 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.937720 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:15:10.938976 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:14:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:10.957389 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-ec7834ca-00db-4daa-a9de-2b1d1e9a6909 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:10.965152 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-ec7834ca-00db-4daa-a9de-2b1d1e9a6909 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 817 time: 0.5077589 Nov 24 11:15:10.970522 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:10.987436 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8d0543d-6c07-4bdf-b005-80612ea0a6f5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=39618ffb-436b-4226-8a0a-385955e4e57c,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:11.006295 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-349da108-c2bd-4ea8-9261-d73e3effa2a2 None None] Pushing event updated for resources: {'Port': ['ID=19717b1c-5b56-45d5-911e-2c1406e74b2b,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:11.010890 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-51dce335-e365-403d-85cc-3539e609ea1c req-dafc6094-8d1f-4c9b-856c-00187bbc6561 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 210 time: 0.1029205 Nov 24 11:15:11.022487 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-7a9184a4-3b12-46c8-8000-789acac6761c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:11.027205 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-7a9184a4-3b12-46c8-8000-789acac6761c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "GET /v2.0/networks?id=8558262b-7125-4688-a6ea-2f1d2c3b2876 HTTP/1.1" status: 200 len: 815 time: 0.4334548 Nov 24 11:15:11.028678 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-da2ae886-b689-48dc-bb4e-1620da52cb50 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/quotas/70ea7b83799640618db2c87847a8ecea HTTP/1.1" status: 200 len: 375 time: 0.0624511 Nov 24 11:15:11.044395 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Request body: {'port': {'device_id': 'b4304784-90ed-4c3d-8dfe-c9e1397abf4d', 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876', 'admin_state_up': True, 'tenant_id': 'fae8312f669b48b797904792401edfa4'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:11.188700 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-2efcc56e-d3a1-43d8-9b0d-be0d5db90c04 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1588798 Nov 24 11:15:11.196375 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a8d0543d-6c07-4bdf-b005-80612ea0a6f5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:11.201152 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52806) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:11.203322 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-a8d0543d-6c07-4bdf-b005-80612ea0a6f5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8872817 Nov 24 11:15:11.211679 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-155839d4-cf19-4ab1-952b-c368e483adec tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Request body: {'security_group_rule': {'security_group_id': '4d84d439-4e42-43d6-9a84-d7924912abec', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:11.254913 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-1639f2bd-4ad5-4ff5-904e-19c8ccf53016 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:11.262606 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:15:11.291662 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f229c1b7-f5a2-4870-9601-79e70c455855 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:11.330643 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Made reservation on behalf of fae8312f669b48b797904792401edfa4 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:15:11.344354 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:11.349280 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-141cf778-7928-4b19-ac9e-63b585f51717 req-afa6bf80-660c-440f-88f4-88b52872b249 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 210 time: 0.0358121 Nov 24 11:15:11.364104 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:11.369513 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-f229c1b7-f5a2-4870-9601-79e70c455855 None None] For port 19717b1c-5b56-45d5-911e-2c1406e74b2b, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=19717b1c-5b56-45d5-911e-2c1406e74b2b,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:11.399751 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Network 86e5ef24-6f2b-4928-b692-ecb9fd8c0b23 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:15:11.442260 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f229c1b7-f5a2-4870-9601-79e70c455855 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:11.460087 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:15:11.542571 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f229c1b7-f5a2-4870-9601-79e70c455855 None None] Pushing event updated for resources: {'Port': ['ID=19717b1c-5b56-45d5-911e-2c1406e74b2b,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:11.581560 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:15:11.598273 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:11.599320 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for port, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:11.608427 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-f7785631-21c6-4f13-bf1c-5698d1335a19 None None] Provisioning complete for port 19717b1c-5b56-45d5-911e-2c1406e74b2b triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:11.608427 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f7785631-21c6-4f13-bf1c-5698d1335a19 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:11.640676 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52814) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:11.724463 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:10Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:11.727586 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-85fcabe7-762d-4dde-98d4-3fde677e52de service neutron] 10.222.0.76 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5103338 Nov 24 11:15:11.806853 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-646f0406-0ab3-405e-8e47-e4c1326715f3 None None] The sync data for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi is: [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:10Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:15:11.887598 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Pushing event updated for resources: {'Port': ['ID=1c0adb45-b280-450a-b0f3-3c1f7c926920,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:12.091787 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-5bd7a204-24e9-4473-989f-deae4ea31a80 service neutron] 10.222.0.76 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3509595 Nov 24 11:15:12.108710 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-155839d4-cf19-4ab1-952b-c368e483adec tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:12.234036 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-4cbb0536-2e52-4032-893f-5b41389a1caa tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.9149292 Nov 24 11:15:12.239082 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a87dec1f-ad4f-405b-a51a-72eaffc25e44 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:12.429746 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-155839d4-cf19-4ab1-952b-c368e483adec tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:12.436546 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:12.442756 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-a4ca669e-b628-4371-8500-4c1a69fbb554 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:15:12.442756 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-a4ca669e-b628-4371-8500-4c1a69fbb554 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.86 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0635202 Nov 24 11:15:12.514361 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Allocated IP 172.20.0.6 (8558262b-7125-4688-a6ea-2f1d2c3b2876/cd868cb4-b7fb-4350-b027-a21baabac768/af19a68f-fbb1-4d8c-9034-627d69f6dfd0) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:15:12.535065 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6de0bb67-8f22-4227-ae54-0fb483c80f0a req-a7d29055-39b2-4038-af3d-17e8de065415 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:12.557299 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6de0bb67-8f22-4227-ae54-0fb483c80f0a req-a7d29055-39b2-4038-af3d-17e8de065415 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 931 time: 0.3186500 Nov 24 11:15:12.564251 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-155839d4-cf19-4ab1-952b-c368e483adec tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:12.603707 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a87dec1f-ad4f-405b-a51a-72eaffc25e44 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:12.673142 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-155839d4-cf19-4ab1-952b-c368e483adec tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0e70e8ff-19ce-4564-8c09-73f68d78fbf4,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:12.678384 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a87dec1f-ad4f-405b-a51a-72eaffc25e44 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:12.714330 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-155839d4-cf19-4ab1-952b-c368e483adec tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:12.722840 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-155839d4-cf19-4ab1-952b-c368e483adec tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.5204539 Nov 24 11:15:12.727130 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52844) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:12.757520 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Request body: {'floatingip': {'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:12.854099 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6de0bb67-8f22-4227-ae54-0fb483c80f0a req-4e16fda6-109f-4dbf-a3cf-ec32c8df06ea tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2955208 Nov 24 11:15:12.887216 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a87dec1f-ad4f-405b-a51a-72eaffc25e44 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8edecae2-4b75-47a3-b7bb-17f834495cf1,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:12.958051 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-a87dec1f-ad4f-405b-a51a-72eaffc25e44 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=fbfb14abfc7e48499c649114a5c30301&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3166063 Nov 24 11:15:12.962168 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52850) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:13.104077 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 19717b1c-5b56-45d5-911e-2c1406e74b2b up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:15:13.112045 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d4e4eb2f-a071-4c7f-a13c-cf7d6013044b req-c79b2edd-44a6-4b29-b973-0938c2c6cc87 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.1008625 Nov 24 11:15:13.209998 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ea3558b8-e085-4690-a45c-641e7ae5c03f req-f58349b4-ae80-43da-9e3c-0ed3b250b60f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 210 time: 0.1087112 Nov 24 11:15:13.210692 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f497b858-c97b-4aaf-b3ae-1a9888e380a6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:13.217101 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:13.230047 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 19717b1c-5b56-45d5-911e-2c1406e74b2b triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:13.240358 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:13.242293 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Request body: {'port': {'device_id': 'ed7b28e1-4fea-4e73-abbc-496e22238856', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:13.291338 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:13.411730 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:13.495435 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Network 8558262b-7125-4688-a6ea-2f1d2c3b2876 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:15:13.556487 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f497b858-c97b-4aaf-b3ae-1a9888e380a6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:13.568681 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:15:13.580134 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:15:13.596820 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:13.598288 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:13.728148 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.6878295 Nov 24 11:15:13.751766 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bac526dc-1af2-4c52-bf6a-be2e8bd5d06f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Pushing event updated for resources: {'Port': ['ID=af19a68f-fbb1-4d8c-9034-627d69f6dfd0,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:13.794386 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:14.131621 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:14.184406 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f497b858-c97b-4aaf-b3ae-1a9888e380a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:14.187336 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f497b858-c97b-4aaf-b3ae-1a9888e380a6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:14.192832 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-f497b858-c97b-4aaf-b3ae-1a9888e380a6 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/8edecae2-4b75-47a3-b7bb-17f834495cf1 HTTP/1.1" status: 204 len: 168 time: 1.2250025 Nov 24 11:15:14.231718 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f497b858-c97b-4aaf-b3ae-1a9888e380a6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8edecae2-4b75-47a3-b7bb-17f834495cf1,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:14.291829 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3b933ce3-6cec-4e25-8d89-6b6eded62783 req-e9424a63-25aa-43ae-bb94-d63e7e933a7b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.0663173 Nov 24 11:15:14.306228 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:14.372405 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e363eec-9606-4d59-aa38-7d56039c30ea req-bbc09583-4241-47ee-b380-e7afa75390b8 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:14.380040 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1e363eec-9606-4d59-aa38-7d56039c30ea req-bbc09583-4241-47ee-b380-e7afa75390b8 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 931 time: 0.3313715 Nov 24 11:15:14.385453 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52886) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:14.463612 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Request body: {'port': {'device_id': 'b4304784-90ed-4c3d-8dfe-c9e1397abf4d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:14.655511 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e42f3486-70c9-453c-950d-da8bbdc41c5d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:14.685508 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:14.728948 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1e363eec-9606-4d59-aa38-7d56039c30ea req-2a744ca4-df85-4b97-b674-3a297ebefba3 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2999637 Nov 24 11:15:14.775160 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a9d698-c8a1-412e-889d-bca463ccee5d req-ae060e82-882c-4306-ad81-eaf09a96bb59 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:14.779645 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-04a9d698-c8a1-412e-889d-bca463ccee5d req-ae060e82-882c-4306-ad81-eaf09a96bb59 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 931 time: 0.3391461 Nov 24 11:15:14.925228 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:14.937842 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Allocated IP 172.27.3.245 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/50a2e02a-dcf5-4d48-b73e-07210118997a) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:15:14.972298 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1c0adb45-b280-450a-b0f3-3c1f7c926920 {{(pid=103244) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:15:15.016581 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:15.040993 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e42f3486-70c9-453c-950d-da8bbdc41c5d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:15.083169 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.provisioning_blocks [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Transition to ACTIVE for port object 1c0adb45-b280-450a-b0f3-3c1f7c926920 will not be triggered until provisioned by entity L2. {{(pid=103244) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:15:15.116488 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-04a9d698-c8a1-412e-889d-bca463ccee5d req-a14f080c-51fe-4cee-8e2f-7f9a55942ba7 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2396166 Nov 24 11:15:15.270988 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:15.393598 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e42f3486-70c9-453c-950d-da8bbdc41c5d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:15.426311 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-96f770da-b805-47ff-9484-335f678c2d7e req-01f5f632-36d8-499d-a24c-f2ea9f6f49f4 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.0352912 Nov 24 11:15:15.478917 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:15.496920 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e42f3486-70c9-453c-950d-da8bbdc41c5d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae9efff8-ddc5-411b-bcd3-b375063296f6,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:15.502072 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-e42f3486-70c9-453c-950d-da8bbdc41c5d admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=936f458b030549ce85872c6b64bf8805&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1153922 Nov 24 11:15:15.508778 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52918) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:15.558626 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Pushing event updated for resources: {'Port': ['ID=1c0adb45-b280-450a-b0f3-3c1f7c926920,revision_number=2']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:15.571023 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:15.629601 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-22018f7c-bd66-4a2b-999f-72b6b471789b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:15.662368 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-22018f7c-bd66-4a2b-999f-72b6b471789b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:15.809192 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id af19a68f-fbb1-4d8c-9034-627d69f6dfd0 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:15:15.825305 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:15.850064 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-22018f7c-bd66-4a2b-999f-72b6b471789b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:15.858205 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-22018f7c-bd66-4a2b-999f-72b6b471789b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:15.858205 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-22018f7c-bd66-4a2b-999f-72b6b471789b admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/ae9efff8-ddc5-411b-bcd3-b375063296f6 HTTP/1.1" status: 204 len: 168 time: 0.3462119 Nov 24 11:15:15.888223 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Transition to ACTIVE for port object af19a68f-fbb1-4d8c-9034-627d69f6dfd0 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:15:15.906535 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22018f7c-bd66-4a2b-999f-72b6b471789b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae9efff8-ddc5-411b-bcd3-b375063296f6,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:15.999443 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:15:16.019155 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:15:16.040792 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:15:16.087449 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event updated for resources: {'Port': ['ID=50a2e02a-dcf5-4d48-b73e-07210118997a,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:16.141582 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:16.161548 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.managers [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Attempting to bind port 1c0adb45-b280-450a-b0f3-3c1f7c926920 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103244) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:15:16.161975 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.managers [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Attempting to bind port 1c0adb45-b280-450a-b0f3-3c1f7c926920 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '6c194338-e70c-49da-8985-8d59db407c63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1209, 'network_id': '86e5ef24-6f2b-4928-b692-ecb9fd8c0b23'}] {{(pid=103244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:15:16.162337 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Attempting to bind port 1c0adb45-b280-450a-b0f3-3c1f7c926920 on network 86e5ef24-6f2b-4928-b692-ecb9fd8c0b23 {{(pid=103244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:15:16.247979 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Port 1c0adb45-b280-450a-b0f3-3c1f7c926920 on network 86e5ef24-6f2b-4928-b692-ecb9fd8c0b23 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:15:16.248298 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Attempting to bind port 1c0adb45-b280-450a-b0f3-3c1f7c926920 on network 86e5ef24-6f2b-4928-b692-ecb9fd8c0b23 {{(pid=103244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:15:16.294555 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 15, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:15:16.294888 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Checking segment: {'id': '6c194338-e70c-49da-8985-8d59db407c63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1209, 'network_id': '86e5ef24-6f2b-4928-b692-ecb9fd8c0b23'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:15:16.295480 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Bound using segment: {'id': '6c194338-e70c-49da-8985-8d59db407c63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1209, 'network_id': '86e5ef24-6f2b-4928-b692-ecb9fd8c0b23'} {{(pid=103244) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:15:16.295914 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.managers [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Bound port: 1c0adb45-b280-450a-b0f3-3c1f7c926920, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6c194338-e70c-49da-8985-8d59db407c63', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1209, 'network_id': '86e5ef24-6f2b-4928-b692-ecb9fd8c0b23'}}] {{(pid=103244) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:15:16.296261 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:16.309558 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7870f93-9765-4265-8740-30ad7bf27aa9 req-a056ccaf-fcda-450a-b173-d847d44bb805 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:16.311177 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a7870f93-9765-4265-8740-30ad7bf27aa9 req-a056ccaf-fcda-450a-b173-d847d44bb805 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 943 time: 0.3249564 Nov 24 11:15:16.335710 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:16.356719 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Pushing event updated for resources: {'Port': ['ID=af19a68f-fbb1-4d8c-9034-627d69f6dfd0,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:16.364487 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Attempting to bind port af19a68f-fbb1-4d8c-9034-627d69f6dfd0 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:15:16.364910 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Attempting to bind port af19a68f-fbb1-4d8c-9034-627d69f6dfd0 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:15:16.365324 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Attempting to bind port af19a68f-fbb1-4d8c-9034-627d69f6dfd0 on network 8558262b-7125-4688-a6ea-2f1d2c3b2876 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:15:16.401329 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Port af19a68f-fbb1-4d8c-9034-627d69f6dfd0 on network 8558262b-7125-4688-a6ea-2f1d2c3b2876 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:15:16.429714 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Attempting to bind port af19a68f-fbb1-4d8c-9034-627d69f6dfd0 on network 8558262b-7125-4688-a6ea-2f1d2c3b2876 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:15:16.429714 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 15, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:15:16.429714 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Checking segment: {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:15:16.429714 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Bound using segment: {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:15:16.429714 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Bound port: af19a68f-fbb1-4d8c-9034-627d69f6dfd0, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:15:16.429714 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:16.472065 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a7870f93-9765-4265-8740-30ad7bf27aa9 req-040cba0b-17ad-4a27-807a-fa02642441c8 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1361957 Nov 24 11:15:16.492458 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c779af-0641-434d-aab7-3e14d02380ad req-723d457b-0245-4cb5-80df-9da2d2d45ba7 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:16.493988 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-07c779af-0641-434d-aab7-3e14d02380ad req-723d457b-0245-4cb5-80df-9da2d2d45ba7 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 943 time: 0.1818883 Nov 24 11:15:16.512390 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] For port 1c0adb45-b280-450a-b0f3-3c1f7c926920, host hv-cinder-80403, cleared binding levels {{(pid=103244) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:15:16.523108 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] For port 1c0adb45-b280-450a-b0f3-3c1f7c926920, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=1c0adb45-b280-450a-b0f3-3c1f7c926920,segment=NetworkSegment(6c194338-e70c-49da-8985-8d59db407c63),segment_id=6c194338-e70c-49da-8985-8d59db407c63)] {{(pid=103244) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:15:16.529839 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] For port af19a68f-fbb1-4d8c-9034-627d69f6dfd0, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:15:16.547630 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] For port af19a68f-fbb1-4d8c-9034-627d69f6dfd0, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=af19a68f-fbb1-4d8c-9034-627d69f6dfd0,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:15:16.633849 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:16.634368 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-07c779af-0641-434d-aab7-3e14d02380ad req-af620e15-dda7-438b-baa4-d78bf585f09d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1193459 Nov 24 11:15:16.658735 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:16.735167 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:16.735839 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for port, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:16.738153 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] 10.222.0.86 "PUT /v2.0/ports/1c0adb45-b280-450a-b0f3-3c1f7c926920 HTTP/1.1" status: 200 len: 1093 time: 3.8701313 Nov 24 11:15:16.738807 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:16.743801 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ed7b28e1-4fea-4e73-abbc-496e22238856', 'tag': '1c0adb45-b280-450a-b0f3-3c1f7c926920'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:15:16.747355 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:16.748157 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:16.750117 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] 10.222.0.86 "PUT /v2.0/ports/af19a68f-fbb1-4d8c-9034-627d69f6dfd0 HTTP/1.1" status: 200 len: 1093 time: 2.2951531 Nov 24 11:15:16.751312 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b4304784-90ed-4c3d-8dfe-c9e1397abf4d', 'tag': 'af19a68f-fbb1-4d8c-9034-627d69f6dfd0'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:15:16.806276 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-905689f5-67e5-4b83-a38d-8edb708911b6 req-0f07c565-1b64-4e19-a291-25897cebd1ef tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.1430104 Nov 24 11:15:16.882641 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b27c543c-6576-4113-acd0-535dfcb5f187 service neutron] Pushing event updated for resources: {'Port': ['ID=af19a68f-fbb1-4d8c-9034-627d69f6dfd0,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:16.931658 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcfaab84-7018-4878-bb18-913abccef670 service neutron] Pushing event updated for resources: {'Port': ['ID=1c0adb45-b280-450a-b0f3-3c1f7c926920,revision_number=3']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:16.959668 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 52964) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:16.984011 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2db58725-3bb2-436c-8d4c-043c7889a8d5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:17.142028 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2db58725-3bb2-436c-8d4c-043c7889a8d5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:17.175812 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for port, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:17.189739 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c9a75bd4-5ee1-4245-bb4e-3a8f771e884e" -d '{"events": [{"name": "network-changed", "server_uuid": "b4304784-90ed-4c3d-8dfe-c9e1397abf4d", "tag": "af19a68f-fbb1-4d8c-9034-627d69f6dfd0"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:15:17.241219 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0afa66f5-3381-4fa4-8890-e2268fca3444" -d '{"events": [{"name": "network-changed", "server_uuid": "ed7b28e1-4fea-4e73-abbc-496e22238856", "tag": "1c0adb45-b280-450a-b0f3-3c1f7c926920"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:15:17.417642 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2db58725-3bb2-436c-8d4c-043c7889a8d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:17.435286 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:15:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33dffdf1-2aa4-455c-bef2-230b4b55be41 x-openstack-request-id: req-33dffdf1-2aa4-455c-bef2-230b4b55be41 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:15:17.435286 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b4304784-90ed-4c3d-8dfe-c9e1397abf4d", "tag": "af19a68f-fbb1-4d8c-9034-627d69f6dfd0", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:15:17.435286 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-33dffdf1-2aa4-455c-bef2-230b4b55be41 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:15:17.435286 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b4304784-90ed-4c3d-8dfe-c9e1397abf4d', 'tag': 'af19a68f-fbb1-4d8c-9034-627d69f6dfd0', 'status': 'completed', 'code': 200} Nov 24 11:15:17.478387 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-2db58725-3bb2-436c-8d4c-043c7889a8d5 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=b637baeaeb344db4b6bc0ef3105cd21c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5174782 Nov 24 11:15:17.483393 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2db58725-3bb2-436c-8d4c-043c7889a8d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=484249f9-2549-4818-9fb4-e4bc010e4682,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:17.483557 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 52990) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:17.513268 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:15:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6daf1155-d06c-4939-ab0f-8ab8c711b7c0 x-openstack-request-id: req-6daf1155-d06c-4939-ab0f-8ab8c711b7c0 {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:15:17.513580 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ed7b28e1-4fea-4e73-abbc-496e22238856", "tag": "1c0adb45-b280-450a-b0f3-3c1f7c926920", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:15:17.513830 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-6daf1155-d06c-4939-ab0f-8ab8c711b7c0 {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:15:17.514291 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ed7b28e1-4fea-4e73-abbc-496e22238856', 'tag': '1c0adb45-b280-450a-b0f3-3c1f7c926920', 'status': 'completed', 'code': 200} Nov 24 11:15:17.548432 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a19b30ef-85b2-4d2f-ad9a-23d3f22fa611 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:17.574729 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:17.585495 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a19b30ef-85b2-4d2f-ad9a-23d3f22fa611 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:17.637866 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:17.801777 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event updated for resources: {'Port': ['ID=50a2e02a-dcf5-4d48-b73e-07210118997a,revision_number=2']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:17.801777 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5829c71c-00e0-4332-80e9-fc12e78462f9 req-cecb9537-fd4c-4007-bf29-b78a9862ffbf tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:17.801777 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5829c71c-00e0-4332-80e9-fc12e78462f9 req-cecb9537-fd4c-4007-bf29-b78a9862ffbf tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 943 time: 0.1046922 Nov 24 11:15:17.820389 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5829c71c-00e0-4332-80e9-fc12e78462f9 req-719c5abe-ae83-440b-a015-73dc4adf5ff9 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736158 Nov 24 11:15:17.828784 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f17e0a3-178c-49e3-935d-c0c17dabc9bf req-910e6f50-c726-4452-9694-9a44ef132697 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:17.837319 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7f17e0a3-178c-49e3-935d-c0c17dabc9bf req-910e6f50-c726-4452-9694-9a44ef132697 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 943 time: 0.0988777 Nov 24 11:15:17.942689 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7f17e0a3-178c-49e3-935d-c0c17dabc9bf req-d751e07d-76f1-4541-9d3f-95b3aecfdad1 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1008494 Nov 24 11:15:17.971468 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:17.977011 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-06795e31-63ba-4703-8ab2-bc246c8a6a4c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 5.2293627 Nov 24 11:15:17.994381 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2d01b040-fd87-411c-a3a7-32edda6b51c8 req-64ce5062-cf41-4fc8-a121-dba94a933f8f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.0490112 Nov 24 11:15:18.004816 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a19b30ef-85b2-4d2f-ad9a-23d3f22fa611 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:18.007424 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a19b30ef-85b2-4d2f-ad9a-23d3f22fa611 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:18.024108 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-a19b30ef-85b2-4d2f-ad9a-23d3f22fa611 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/484249f9-2549-4818-9fb4-e4bc010e4682 HTTP/1.1" status: 204 len: 168 time: 0.5268869 Nov 24 11:15:18.024108 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a19b30ef-85b2-4d2f-ad9a-23d3f22fa611 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=484249f9-2549-4818-9fb4-e4bc010e4682,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:18.273028 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-ed9a9d35-4f9f-4a7f-905c-d22a2258eff1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?name=tempest-securitygroup--1604758842&fields=id&tenant_id=907128185ff9473381be53050d202838 HTTP/1.1" status: 200 len: 267 time: 0.0485759 Nov 24 11:15:18.420314 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-3b49415b-ee40-4241-9b42-e4ba43f6f2e9 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:18.421822 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-3b49415b-ee40-4241-9b42-e4ba43f6f2e9 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/networks?id=d9d87ca8-7863-48a6-937c-ee712996776e HTTP/1.1" status: 200 len: 811 time: 0.1420517 Nov 24 11:15:18.446455 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-7916cb92-3520-4b0b-bdf5-c71ec0d1d410 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/quotas/907128185ff9473381be53050d202838 HTTP/1.1" status: 200 len: 375 time: 0.0139818 Nov 24 11:15:18.519737 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-eb291314-fa4e-40f7-bc16-b55cc32e5008 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=907128185ff9473381be53050d202838&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0548992 Nov 24 11:15:18.640174 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-c5264d50-7d1e-41c8-a006-0d79042a288d service neutron] 10.222.0.76 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1120522 Nov 24 11:15:18.758369 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-758797da-63f1-42d1-adc0-9963794a30e5 service neutron] 10.222.0.76 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1059706 Nov 24 11:15:19.013942 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 53060) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:19.125187 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e430f40-8697-4abd-8300-e9de6b264035 req-a681af40-be15-47fe-ac22-f3fa6be2f60a tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:19.129916 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8e430f40-8697-4abd-8300-e9de6b264035 req-a681af40-be15-47fe-ac22-f3fa6be2f60a tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 943 time: 0.1563654 Nov 24 11:15:19.147469 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ab3d6168-b1d5-47b7-9471-6d098b5a9648 req-78ac2777-ef55-4e22-a8d7-ca75d153b5cc tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 210 time: 0.0958230 Nov 24 11:15:19.200424 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-913fdddc-18d9-49cd-8291-933db53ae382 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:19.319826 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8e430f40-8697-4abd-8300-e9de6b264035 req-14179018-ce92-4121-80a8-c4b1efc39fd4 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1592205 Nov 24 11:15:19.377168 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-913fdddc-18d9-49cd-8291-933db53ae382 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:19.389094 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bb66d1f-6014-486c-8810-09d6f0b8ebc0 req-de9dfc07-aa2f-4b99-b57c-1e4894b8f476 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:19.390612 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1bb66d1f-6014-486c-8810-09d6f0b8ebc0 req-de9dfc07-aa2f-4b99-b57c-1e4894b8f476 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 943 time: 0.0698025 Nov 24 11:15:19.454762 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0a7d34c5-2558-48b4-b90d-cbebee3496d2 req-806671f3-40c0-4b98-a500-04ec77132aba tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.0389407 Nov 24 11:15:19.485344 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1bb66d1f-6014-486c-8810-09d6f0b8ebc0 req-3928e48a-a846-4fd1-bcf0-37155c363e25 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828643 Nov 24 11:15:19.599592 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-913fdddc-18d9-49cd-8291-933db53ae382 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:19.647489 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-913fdddc-18d9-49cd-8291-933db53ae382 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=60d6e8b550c7430ab51725081edc44e8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6315536 Nov 24 11:15:19.648678 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-913fdddc-18d9-49cd-8291-933db53ae382 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=edd42a28-e6b7-4deb-b424-b04bdecf89a0,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:19.650428 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53086) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:19.724552 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-65b57022-2bca-4eb7-b113-51b068f23fb2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:19.772585 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-65b57022-2bca-4eb7-b113-51b068f23fb2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:20.021407 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-65b57022-2bca-4eb7-b113-51b068f23fb2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:20.024268 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-65b57022-2bca-4eb7-b113-51b068f23fb2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:20.025669 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-65b57022-2bca-4eb7-b113-51b068f23fb2 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/edd42a28-e6b7-4deb-b424-b04bdecf89a0 HTTP/1.1" status: 204 len: 168 time: 0.3734727 Nov 24 11:15:20.036297 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65b57022-2bca-4eb7-b113-51b068f23fb2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=edd42a28-e6b7-4deb-b424-b04bdecf89a0,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:20.257661 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-49f32d9b-7225-4db1-a735-73bfc8473f2f req-17f2dc57-75d1-49ca-89b7-fa6b88a720bf tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 210 time: 0.0276551 Nov 24 11:15:20.448882 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad127d41-9f02-407a-9fb6-91e3a386ca60 req-35be6077-4ebe-4d29-9afb-e538e52d79d8 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:20.450635 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ad127d41-9f02-407a-9fb6-91e3a386ca60 req-35be6077-4ebe-4d29-9afb-e538e52d79d8 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 943 time: 0.0549207 Nov 24 11:15:20.550847 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ad127d41-9f02-407a-9fb6-91e3a386ca60 req-5108212e-ddfd-46dd-966f-eb61ce0fcc66 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0918753 Nov 24 11:15:20.619714 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-57df4323-0bea-4f59-9598-8cd7ed51cf64 req-b19d84c8-6844-4a78-838e-aaad767b5c25 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.0576851 Nov 24 11:15:20.719439 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4b40511-73e0-4208-99c5-719adc9a3507 req-4996053f-9c36-45b0-9b19-b1a4f8970f51 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:20.726247 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e4b40511-73e0-4208-99c5-719adc9a3507 req-4996053f-9c36-45b0-9b19-b1a4f8970f51 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 943 time: 0.0597143 Nov 24 11:15:20.790872 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e4b40511-73e0-4208-99c5-719adc9a3507 req-ebab865c-4d45-4519-b541-34b291d91534 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547740 Nov 24 11:15:21.026877 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53128) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:21.054708 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ce7f894e-9bbb-4bc6-bc56-62a60a90a4a1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:21.137969 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ce7f894e-9bbb-4bc6-bc56-62a60a90a4a1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:21.187051 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ce7f894e-9bbb-4bc6-bc56-62a60a90a4a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:21.229016 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-ce7f894e-9bbb-4bc6-bc56-62a60a90a4a1 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=e2599046f1cb465f8f0068bc5c9082bc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2008579 Nov 24 11:15:21.229963 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce7f894e-9bbb-4bc6-bc56-62a60a90a4a1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b31c86a-109c-4c3a-92cc-7803035073e8,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:21.232146 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 53134) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:21.293204 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f42f2991-1cc4-4d4f-a5e8-28b88d3f6ea1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:21.323437 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f42f2991-1cc4-4d4f-a5e8-28b88d3f6ea1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:21.388878 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cb979e15-3341-4baf-ae93-36a8cb480c74 req-2fdd44c2-53dd-4479-ab2c-fc8ae84bda7e tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 210 time: 0.0282648 Nov 24 11:15:21.473306 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f42f2991-1cc4-4d4f-a5e8-28b88d3f6ea1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:21.475938 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f42f2991-1cc4-4d4f-a5e8-28b88d3f6ea1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:21.477088 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-f42f2991-1cc4-4d4f-a5e8-28b88d3f6ea1 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/4b31c86a-109c-4c3a-92cc-7803035073e8 HTTP/1.1" status: 204 len: 168 time: 0.2439706 Nov 24 11:15:21.485067 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f42f2991-1cc4-4d4f-a5e8-28b88d3f6ea1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b31c86a-109c-4c3a-92cc-7803035073e8,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:21.683047 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b21b4915-e377-43a4-ac19-d61e402eec39 req-9bdf28d2-ba88-45c9-b7b8-bddda95bd900 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:21.684884 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b21b4915-e377-43a4-ac19-d61e402eec39 req-9bdf28d2-ba88-45c9-b7b8-bddda95bd900 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 943 time: 0.0644119 Nov 24 11:15:21.767585 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-aeb497ff-c240-428a-a1e8-6bf91f89515e req-dae90cd7-403a-485b-b852-74a14a7f90ce tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.0592701 Nov 24 11:15:21.804184 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b21b4915-e377-43a4-ac19-d61e402eec39 req-91a66b7c-955c-4e30-ae1d-1dd64f549c2e tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1088307 Nov 24 11:15:21.915462 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e914e885-7972-4fba-b161-97f5441a1172 req-b80c381e-982c-4dc7-b7e6-e11825283e90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:21.915462 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e914e885-7972-4fba-b161-97f5441a1172 req-b80c381e-982c-4dc7-b7e6-e11825283e90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 943 time: 0.0535638 Nov 24 11:15:21.987135 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e914e885-7972-4fba-b161-97f5441a1172 req-2266af99-bda6-4a35-8320-02ae108ac6e1 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658419 Nov 24 11:15:21.987837 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 53166) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:22.146572 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5593b363-c525-45aa-bd94-e34422a36d65 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:22.229581 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5593b363-c525-45aa-bd94-e34422a36d65 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:22.297933 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5593b363-c525-45aa-bd94-e34422a36d65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:22.346467 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5593b363-c525-45aa-bd94-e34422a36d65 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c1d996e0-3c36-4e2e-b7b0-e13609d9f67b,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:22.351036 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-5593b363-c525-45aa-bd94-e34422a36d65 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=ef50f0a30b944a8a8e892c2387433bb8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3619459 Nov 24 11:15:22.354432 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 53184) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:22.429661 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6e87afa0-93e1-4c45-a988-e498971eaa31 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:22.465350 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6e87afa0-93e1-4c45-a988-e498971eaa31 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:22.543512 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ec9c8fc9-b62d-4c84-9c22-01b6fd8f8e24 req-9891652b-bdb0-45f6-b497-4da7444de275 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 210 time: 0.0596378 Nov 24 11:15:22.605285 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6e87afa0-93e1-4c45-a988-e498971eaa31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:22.608454 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6e87afa0-93e1-4c45-a988-e498971eaa31 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:22.610723 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-6e87afa0-93e1-4c45-a988-e498971eaa31 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/c1d996e0-3c36-4e2e-b7b0-e13609d9f67b HTTP/1.1" status: 204 len: 168 time: 0.2559209 Nov 24 11:15:22.623793 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e87afa0-93e1-4c45-a988-e498971eaa31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c1d996e0-3c36-4e2e-b7b0-e13609d9f67b,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:22.906565 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b9c34d19-5676-41b0-9a8a-dced34d94ada req-77954124-0995-4827-8879-c568a2426842 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.0623353 Nov 24 11:15:22.982048 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-278accaf-19c2-4064-938c-3ce91f828454 req-26247ad9-b2da-476f-b9aa-1224f1286a33 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:22.982048 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-278accaf-19c2-4064-938c-3ce91f828454 req-26247ad9-b2da-476f-b9aa-1224f1286a33 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 943 time: 0.0706975 Nov 24 11:15:23.061289 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-278accaf-19c2-4064-938c-3ce91f828454 req-5a99e8e5-0a8e-47b7-84e9-83e4bb9aa926 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674784 Nov 24 11:15:23.145914 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014dd585-f341-475a-9c90-d8f23f788781 req-474f8900-d77c-4cd2-81ee-9d6c4dde3828 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:23.147426 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-014dd585-f341-475a-9c90-d8f23f788781 req-474f8900-d77c-4cd2-81ee-9d6c4dde3828 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 943 time: 0.0594380 Nov 24 11:15:23.206595 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-014dd585-f341-475a-9c90-d8f23f788781 req-9f322f84-4513-4ffa-ac31-a8d11b1ac6ed tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479896 Nov 24 11:15:23.368451 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53236) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:23.382343 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d3bc603-ba6d-4747-962e-c3e83b5f0da3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:23.463356 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d3bc603-ba6d-4747-962e-c3e83b5f0da3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:23.507358 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d3bc603-ba6d-4747-962e-c3e83b5f0da3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:23.545624 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-3d3bc603-ba6d-4747-962e-c3e83b5f0da3 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=de0ba7eeb22b4b6387f1b970d534b1a6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1759100 Nov 24 11:15:23.546652 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d3bc603-ba6d-4747-962e-c3e83b5f0da3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=edd1ad12-7bb1-443a-9488-5eb613b5b603,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:23.548155 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 53246) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:23.593557 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53248) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:23.610177 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d81ea836-c50f-403f-a2cd-752edb70a8e3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:23.635260 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d81ea836-c50f-403f-a2cd-752edb70a8e3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:23.653531 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2f164378-0b95-4999-b9d3-0a30e4811c2c req-5b074697-bcb4-4ab3-8ad6-ad4d057f1cb4 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 210 time: 0.0334380 Nov 24 11:15:23.761435 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-42be89e9-f8db-4f17-908f-b632bec9e160 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:23.764699 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a75bd4-5ee1-4245-bb4e-3a8f771e884e req-e13557c3-6f56-4bf6-8b9a-de366bf1a224 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:23.766473 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c9a75bd4-5ee1-4245-bb4e-3a8f771e884e req-e13557c3-6f56-4bf6-8b9a-de366bf1a224 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 1096 time: 0.0902021 Nov 24 11:15:23.941146 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afa66f5-3381-4fa4-8890-e2268fca3444 req-e2b78fc4-0273-4567-b1b9-301928ded619 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:23.942726 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-0afa66f5-3381-4fa4-8890-e2268fca3444 req-e2b78fc4-0273-4567-b1b9-301928ded619 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=1b97c43049d94ba3b99a111a9b91864d&device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 1096 time: 0.3049960 Nov 24 11:15:24.028941 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d81ea836-c50f-403f-a2cd-752edb70a8e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:24.031551 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d81ea836-c50f-403f-a2cd-752edb70a8e3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:24.032669 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-d81ea836-c50f-403f-a2cd-752edb70a8e3 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/edd1ad12-7bb1-443a-9488-5eb613b5b603 HTTP/1.1" status: 204 len: 168 time: 0.4817107 Nov 24 11:15:24.123226 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d81ea836-c50f-403f-a2cd-752edb70a8e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=edd1ad12-7bb1-443a-9488-5eb613b5b603,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:24.165989 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afa66f5-3381-4fa4-8890-e2268fca3444 req-5acc228d-7218-41b1-962f-d26defb8b7a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:24.167502 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-0afa66f5-3381-4fa4-8890-e2268fca3444 req-5acc228d-7218-41b1-962f-d26defb8b7a6 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=1b97c43049d94ba3b99a111a9b91864d&shared=False HTTP/1.1" status: 200 len: 914 time: 0.2169330 Nov 24 11:15:24.169833 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-569c2261-8fa4-4d9a-ae3c-3ef2f57e505e req-1f5295b1-038e-48f1-b0db-66caf6921ff0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.0664489 Nov 24 11:15:24.275636 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a75bd4-5ee1-4245-bb4e-3a8f771e884e req-ae06e302-342d-406d-bd53-d0dfcaee9653 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:24.277465 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c9a75bd4-5ee1-4245-bb4e-3a8f771e884e req-ae06e302-342d-406d-bd53-d0dfcaee9653 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=fae8312f669b48b797904792401edfa4&shared=False HTTP/1.1" status: 200 len: 917 time: 0.4940031 Nov 24 11:15:24.372105 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afa66f5-3381-4fa4-8890-e2268fca3444 req-0d55e60d-8475-40b5-baf9-6b7473007662 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:24.374380 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-0afa66f5-3381-4fa4-8890-e2268fca3444 req-0d55e60d-8475-40b5-baf9-6b7473007662 service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1969228 Nov 24 11:15:24.384359 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58aa58ff-d241-417c-9149-1548c5fc0a67 req-2fcdfde9-4afe-4959-8b27-c957eec43a95 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:24.385861 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-58aa58ff-d241-417c-9149-1548c5fc0a67 req-2fcdfde9-4afe-4959-8b27-c957eec43a95 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 943 time: 0.2317502 Nov 24 11:15:24.412100 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-42be89e9-f8db-4f17-908f-b632bec9e160 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:24.461853 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.86', 56843) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:24.487099 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-42be89e9-f8db-4f17-908f-b632bec9e160 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:24.492006 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-3df1afab-c854-4afd-a50d-64ddf1bbf084 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:24.494167 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-3df1afab-c854-4afd-a50d-64ddf1bbf084 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=1b97c43049d94ba3b99a111a9b91864d&device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 1096 time: 0.0699220 Nov 24 11:15:24.574551 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d4dfa2-b5d9-46ac-8fdb-a75873d71452 req-23eca85e-332e-4e5e-92f9-0ce8b8d1182e tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:24.582876 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-93d4dfa2-b5d9-46ac-8fdb-a75873d71452 req-23eca85e-332e-4e5e-92f9-0ce8b8d1182e tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 943 time: 0.3013623 Nov 24 11:15:24.584733 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42be89e9-f8db-4f17-908f-b632bec9e160 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ce70761-46f8-488f-a2ec-c3e0e2b79808,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:24.625505 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-42be89e9-f8db-4f17-908f-b632bec9e160 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=07ff579b83f24d77b81940384d840b4e&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0279934 Nov 24 11:15:24.631472 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53290) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:24.643866 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-99c2b3d0-b225-498e-9d37-7ba760b2c604 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=1c0adb45-b280-450a-b0f3-3c1f7c926920 HTTP/1.1" status: 200 len: 217 time: 0.1370120 Nov 24 11:15:24.657802 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-58aa58ff-d241-417c-9149-1548c5fc0a67 req-56ad25c5-2e3c-400f-a485-0bbdde3468e8 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2388914 Nov 24 11:15:24.666022 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9a75bd4-5ee1-4245-bb4e-3a8f771e884e req-6fcf0a86-aad6-48fe-b243-985b1bc0f419 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:24.668035 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c9a75bd4-5ee1-4245-bb4e-3a8f771e884e req-6fcf0a86-aad6-48fe-b243-985b1bc0f419 service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.3768201 Nov 24 11:15:24.726985 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-93d4dfa2-b5d9-46ac-8fdb-a75873d71452 req-c42a1423-d213-478d-a85b-ebda4359e498 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1431022 Nov 24 11:15:24.758105 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53294) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:24.766383 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-10c72776-d7b6-49d1-9bf1-7167b6053f4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:24.769812 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-10c72776-d7b6-49d1-9bf1-7167b6053f4c service neutron] 10.222.0.86 "GET /v2.0/subnets?id=48d293f1-718f-4cda-9b6b-9bfc422e2fdd HTTP/1.1" status: 200 len: 852 time: 0.1128001 Nov 24 11:15:24.789919 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9f2c056c-2d14-414f-808a-277d607dd44f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:24.845094 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-64357d75-e5f1-427a-b26c-7375869ebd31 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=86e5ef24-6f2b-4928-b692-ecb9fd8c0b23&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0655227 Nov 24 11:15:24.849823 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9f2c056c-2d14-414f-808a-277d607dd44f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:24.968625 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-8ee010a7-f5df-446d-8059-5c36c2da9eb2 service neutron] 10.222.0.86 "GET /v2.0/networks/86e5ef24-6f2b-4928-b692-ecb9fd8c0b23?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0958171 Nov 24 11:15:24.979704 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-481c556e-b665-4fed-aec9-c490a9f09203 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:24.981264 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-481c556e-b665-4fed-aec9-c490a9f09203 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 1096 time: 0.2467904 Nov 24 11:15:24.989461 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eed81b08-d66e-4ee9-bf09-57997620d18e req-9217de16-3903-437b-9a79-7c00675bdde4 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 210 time: 0.0597048 Nov 24 11:15:25.003181 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fe5bbf2d-d633-4b3b-bde3-64e405249c0a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:25.005728 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9f2c056c-2d14-414f-808a-277d607dd44f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:25.009512 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9f2c056c-2d14-414f-808a-277d607dd44f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:25.016579 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-9f2c056c-2d14-414f-808a-277d607dd44f admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/6ce70761-46f8-488f-a2ec-c3e0e2b79808 HTTP/1.1" status: 204 len: 168 time: 0.3837953 Nov 24 11:15:25.082388 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-57dd0bd9-aade-4906-97dc-4b8a8e6e38c9 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:25.083934 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-57dd0bd9-aade-4906-97dc-4b8a8e6e38c9 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.86 "GET /v2.0/networks?id=d9d87ca8-7863-48a6-937c-ee712996776e HTTP/1.1" status: 200 len: 811 time: 0.6142874 Nov 24 11:15:25.152225 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f2c056c-2d14-414f-808a-277d607dd44f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ce70761-46f8-488f-a2ec-c3e0e2b79808,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:25.154689 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5383feaa-d4bc-4671-ae4f-9f6b9293e067 req-c4b2e6eb-4771-4eeb-8070-db89d69606af service neutron] 10.222.0.86 "GET /v2.0/networks/86e5ef24-6f2b-4928-b692-ecb9fd8c0b23?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1698225 Nov 24 11:15:25.168115 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-0a207cd1-cb48-4344-ba95-9a5c0d40d83f tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=907128185ff9473381be53050d202838 HTTP/1.1" status: 200 len: 380 time: 0.0726860 Nov 24 11:15:25.185082 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Request body: {'port': {'device_id': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'admin_state_up': True, 'tenant_id': '907128185ff9473381be53050d202838', 'security_groups': ['4d84d439-4e42-43d6-9a84-d7924912abec']}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:25.217883 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-e9c61987-77b0-4455-a8fd-987d694e581f service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=af19a68f-fbb1-4d8c-9034-627d69f6dfd0 HTTP/1.1" status: 200 len: 217 time: 0.1979756 Nov 24 11:15:25.403062 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-68a0b75f-de48-4176-8868-29fb74fed8c4 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:25.404438 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bc2b2b2b-4b33-4552-86cf-71f01e1029ad req-40c730c2-3aa4-4aa2-bed9-aa746eaac697 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.1169229 Nov 24 11:15:25.415914 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-68a0b75f-de48-4176-8868-29fb74fed8c4 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.86 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 817 time: 0.2112379 Nov 24 11:15:25.429775 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-62bf9013-149b-4d79-9b64-831ec88cbbb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:25.431762 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-62bf9013-149b-4d79-9b64-831ec88cbbb8 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=cd868cb4-b7fb-4350-b027-a21baabac768 HTTP/1.1" status: 200 len: 855 time: 0.2012513 Nov 24 11:15:25.496638 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-18fe308f-dbbe-4b3c-bff6-d4b844fd5eea service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=8558262b-7125-4688-a6ea-2f1d2c3b2876&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0538428 Nov 24 11:15:25.500426 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-f4c11af4-98eb-4a28-b05d-d990948aa29c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=70ea7b83799640618db2c87847a8ecea HTTP/1.1" status: 200 len: 380 time: 0.0586214 Nov 24 11:15:25.510522 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fe5bbf2d-d633-4b3b-bde3-64e405249c0a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:25.519678 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Request body: {'port': {'device_id': '54cca4b1-6845-4546-98db-5445a16b80d1', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'admin_state_up': True, 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'security_groups': ['88c1dfcd-809d-471e-ae01-5627ef698662']}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:25.592753 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Made reservation on behalf of 907128185ff9473381be53050d202838 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:15:25.596431 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:25.602920 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-9b9ecbe5-b3b0-4932-9dcc-4318ed62505f service neutron] 10.222.0.86 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0885036 Nov 24 11:15:25.635243 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fe5bbf2d-d633-4b3b-bde3-64e405249c0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:25.673516 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-fe5bbf2d-d633-4b3b-bde3-64e405249c0a admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=c5165023e9cc43b39ff68609f232ab3f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9088230 Nov 24 11:15:25.681605 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53336) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:25.773283 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe5bbf2d-d633-4b3b-bde3-64e405249c0a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08e03872-2fe8-47b7-ac8b-15c58ca78f8d,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:25.833408 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Made reservation on behalf of 70ea7b83799640618db2c87847a8ecea for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:15:25.837064 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:25.888398 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Allocated IP 172.20.0.8 (d9d87ca8-7863-48a6-937c-ee712996776e/c0d420cf-0b8e-4f90-a25c-9a74e1eafabb/dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:15:25.928314 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3f0cbc-3d57-4086-805f-33a592855147 req-9e24a1cd-db3d-4c2a-a2e2-61cba2b968a1 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:25.929732 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7f3f0cbc-3d57-4086-805f-33a592855147 req-9e24a1cd-db3d-4c2a-a2e2-61cba2b968a1 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 943 time: 0.1584916 Nov 24 11:15:25.935162 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-70373326-257f-44d4-a9f8-88c1e9a80765 req-d67869d5-5849-4f9d-90e6-81852e01a979 service neutron] 10.222.0.86 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3239031 Nov 24 11:15:25.935790 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dc26e43f-54d8-4ace-b508-81167b77ee82 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:25.982956 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a7e477f-5fae-4cf7-857f-8986c374ea51 req-1aab064d-c0c4-4df7-8dd0-aad83b0c4cdd tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:25.984592 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5a7e477f-5fae-4cf7-857f-8986c374ea51 req-1aab064d-c0c4-4df7-8dd0-aad83b0c4cdd tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 943 time: 0.1298492 Nov 24 11:15:25.999511 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dc26e43f-54d8-4ace-b508-81167b77ee82 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:26.057718 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7f3f0cbc-3d57-4086-805f-33a592855147 req-6844e91d-1781-4aca-89c4-f34f9e74af5d tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1160972 Nov 24 11:15:26.085072 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Allocated IP 172.20.0.12 (76fcee22-81e5-4608-a546-3b68c56c5ac7/5eae2e87-935a-45b7-89da-586ce04ad644/ebbec69a-2982-4fe3-b07d-5326d6b7f5f3) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:15:26.101119 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5a7e477f-5fae-4cf7-857f-8986c374ea51 req-646865d1-e0e1-42a5-9c65-966a41b824cb tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1064336 Nov 24 11:15:26.176272 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dc26e43f-54d8-4ace-b508-81167b77ee82 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:26.180346 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dc26e43f-54d8-4ace-b508-81167b77ee82 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:26.180550 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-dc26e43f-54d8-4ace-b508-81167b77ee82 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/08e03872-2fe8-47b7-ac8b-15c58ca78f8d HTTP/1.1" status: 204 len: 168 time: 0.4978454 Nov 24 11:15:26.197684 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5b8b60cf-6718-4377-8ab3-be3b7bfd7931 req-a46a893b-58d5-428f-b13b-45fa9eeff55f tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 210 time: 0.0334458 Nov 24 11:15:26.205760 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc26e43f-54d8-4ace-b508-81167b77ee82 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08e03872-2fe8-47b7-ac8b-15c58ca78f8d,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:26.337445 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:26.466792 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:26.501874 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:26.533873 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c83a4003-51b8-4b64-bf17-2cf156614c4d req-dcfff975-5df0-4644-9bd7-ac5c88cd3fcf tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.0495076 Nov 24 11:15:26.558682 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event updated for resources: {'Port': ['ID=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:26.574306 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Network d9d87ca8-7863-48a6-937c-ee712996776e is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:15:26.576222 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:15:26.579665 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:15:26.586612 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:26.587208 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:26.656044 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:26.699810 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-40bb70d8-dbd1-406c-82bd-35781c5bb8a5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.5206997 Nov 24 11:15:26.711800 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Network 76fcee22-81e5-4608-a546-3b68c56c5ac7 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:15:26.715784 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Request body: {'port': {'device_id': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:26.725470 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:15:26.728845 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:15:26.739654 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:26.739654 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:26.774393 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event updated for resources: {'Port': ['ID=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:26.826221 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:26.879773 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-97dc44a3-ac14-4a6d-91a1-feed75041300 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3649356 Nov 24 11:15:26.895477 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Request body: {'port': {'device_id': '54cca4b1-6845-4546-98db-5445a16b80d1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:26.954662 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-abd952d8-a21e-4f29-9f6b-ea7c55270fa8 None None] Provisioning complete for port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:26.957466 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-abd952d8-a21e-4f29-9f6b-ea7c55270fa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:26.977710 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53392) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:26.990570 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9b936d75-08e8-43bf-b96f-957517a28b03 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.022078 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-abd952d8-a21e-4f29-9f6b-ea7c55270fa8 None None] Port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:15:27.037784 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.109105 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9b936d75-08e8-43bf-b96f-957517a28b03 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.148110 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-b44bb628-8384-469b-b02c-c327aa168459 None None] Provisioning complete for port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:27.154339 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b44bb628-8384-469b-b02c-c327aa168459 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.196731 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9b936d75-08e8-43bf-b96f-957517a28b03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.221740 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-b44bb628-8384-469b-b02c-c327aa168459 None None] Port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:15:27.294149 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:15:27.303586 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-9b936d75-08e8-43bf-b96f-957517a28b03 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=66f776aac5674be8b79616f265659472&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3247762 Nov 24 11:15:27.307642 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53410) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:27.312864 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.315847 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b936d75-08e8-43bf-b96f-957517a28b03 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9eb40ba4-653a-4fdc-a5fd-c16a63196034,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:27.325940 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d7bfca7-f381-484b-84a0-15baa88623dd req-26881624-efb2-4f9e-b750-3df8dd8e1c2c tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:27.334515 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2d7bfca7-f381-484b-84a0-15baa88623dd req-26881624-efb2-4f9e-b750-3df8dd8e1c2c tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 943 time: 0.1783352 Nov 24 11:15:27.366437 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Transition to ACTIVE for port object dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:15:27.400358 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d230099-ae79-4515-bef2-279367e12453 req-46a1a51b-52b5-4cd1-9046-b95268aaa96d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:27.401841 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0d230099-ae79-4515-bef2-279367e12453 req-46a1a51b-52b5-4cd1-9046-b95268aaa96d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 943 time: 0.1778350 Nov 24 11:15:27.434996 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2d7bfca7-f381-484b-84a0-15baa88623dd req-58a6351a-a82c-4126-9130-14feb872a5a5 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0979199 Nov 24 11:15:27.468120 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.514272 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-607fb818-7e4d-4ac3-b75f-ad7d384b413f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.514408 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:15:27.541947 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.582283 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 53436) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:27.624402 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Pushing event updated for resources: {'Port': ['ID=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:27.646124 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Transition to ACTIVE for port object ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:15:27.662292 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Attempting to bind port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:15:27.662630 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Attempting to bind port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:15:27.662963 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Attempting to bind port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa on network d9d87ca8-7863-48a6-937c-ee712996776e {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:15:27.671040 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa on network d9d87ca8-7863-48a6-937c-ee712996776e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:15:27.671409 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Attempting to bind port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa on network d9d87ca8-7863-48a6-937c-ee712996776e {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:15:27.683225 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 15, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:15:27.683679 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Checking segment: {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:15:27.684076 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Bound using segment: {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:15:27.684523 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Bound port: dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:15:27.684883 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.715573 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.772852 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Pushing event updated for resources: {'Port': ['ID=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:27.818464 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0d230099-ae79-4515-bef2-279367e12453 req-3fb04e96-0b38-4d64-8c51-e45a05150b32 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4045072 Nov 24 11:15:27.832008 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-607fb818-7e4d-4ac3-b75f-ad7d384b413f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.893670 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f3bcb171-4e6b-4b19-8635-86cdea889af4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:27.921971 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c92c10c8-578e-4084-a0ec-291dab6cbef6 req-4c32d4cb-cc00-4890-bad6-3902a1e0f432 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:27.932185 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c92c10c8-578e-4084-a0ec-291dab6cbef6 req-4c32d4cb-cc00-4890-bad6-3902a1e0f432 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 943 time: 0.1876676 Nov 24 11:15:27.998259 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Attempting to bind port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:15:28.005510 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Attempting to bind port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:15:28.006029 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Attempting to bind port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 on network 76fcee22-81e5-4608-a546-3b68c56c5ac7 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:15:28.023274 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 on network 76fcee22-81e5-4608-a546-3b68c56c5ac7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:15:28.023857 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Attempting to bind port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 on network 76fcee22-81e5-4608-a546-3b68c56c5ac7 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:15:28.038469 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] For port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:15:28.040802 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c92c10c8-578e-4084-a0ec-291dab6cbef6 req-fced932c-45bf-49a2-8d7f-3b3dd5bec08a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1073112 Nov 24 11:15:28.043094 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 15, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:15:28.043910 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Checking segment: {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:15:28.044299 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Bound using segment: {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:15:28.044749 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Bound port: ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:15:28.045109 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.048470 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] For port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:15:28.058176 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ce7c8b-6c35-4ec6-9cf5-162c87820e69 req-7e6766a3-b1cf-4677-9bb3-800ef9ec59b8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:28.059355 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-77ce7c8b-6c35-4ec6-9cf5-162c87820e69 req-7e6766a3-b1cf-4677-9bb3-800ef9ec59b8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.1249027 Nov 24 11:15:28.123808 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f3bcb171-4e6b-4b19-8635-86cdea889af4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.127991 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-607fb818-7e4d-4ac3-b75f-ad7d384b413f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.130573 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-607fb818-7e4d-4ac3-b75f-ad7d384b413f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.132234 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-607fb818-7e4d-4ac3-b75f-ad7d384b413f admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/9eb40ba4-653a-4fdc-a5fd-c16a63196034 HTTP/1.1" status: 204 len: 168 time: 0.8227055 Nov 24 11:15:28.147733 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-77ce7c8b-6c35-4ec6-9cf5-162c87820e69 req-58b1b22c-eb09-4658-9559-2c98e5e5d8f0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0814030 Nov 24 11:15:28.148574 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607fb818-7e4d-4ac3-b75f-ad7d384b413f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9eb40ba4-653a-4fdc-a5fd-c16a63196034,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:28.165627 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.178157 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:15:28.216692 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:28.217299 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.218659 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] 10.222.0.86 "PUT /v2.0/ports/dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa HTTP/1.1" status: 200 len: 1093 time: 1.5091105 Nov 24 11:15:28.220367 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:15:28.221845 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'tag': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:15:28.224108 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c06b73cc-f85e-46ea-aa45-c27e60b4dba9" -d '{"events": [{"name": "network-changed", "server_uuid": "91407c11-277d-4df0-83b5-cbb8696fb8c2", "tag": "dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:15:28.243489 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fee87fd-03e3-4d1c-aa39-873ffdab89b7 service neutron] Pushing event updated for resources: {'Port': ['ID=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:28.274482 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:15:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-160a1528-4b4d-482a-bda1-b512194771a7 x-openstack-request-id: req-160a1528-4b4d-482a-bda1-b512194771a7 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:15:28.274768 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "91407c11-277d-4df0-83b5-cbb8696fb8c2", "tag": "dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:15:28.275021 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-160a1528-4b4d-482a-bda1-b512194771a7 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:15:28.277460 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'tag': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa', 'status': 'completed', 'code': 200} Nov 24 11:15:28.291814 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f3bcb171-4e6b-4b19-8635-86cdea889af4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.364177 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.370380 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3bcb171-4e6b-4b19-8635-86cdea889af4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c6b6a99e-4cbe-4e87-b879-ad4a18104eb6,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:28.394025 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-f3bcb171-4e6b-4b19-8635-86cdea889af4 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=3523b1a13b25431ca437009f8b990bc5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8055899 Nov 24 11:15:28.396825 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53466) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:28.448870 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Pushing event updated for resources: {'Port': ['ID=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:28.486587 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:28.496117 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-03bfbd32-7993-4cc0-9c84-837608c7742e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.502527 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.502527 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-59d22657-104f-463e-aae0-ae8836d8615b service neutron] 10.222.0.86 "PUT /v2.0/ports/ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 HTTP/1.1" status: 200 len: 1094 time: 1.6105590 Nov 24 11:15:28.524998 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c06b73cc-f85e-46ea-aa45-c27e60b4dba9 req-fc155461-667d-42b7-901b-d73b3720b7e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:28.526701 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c06b73cc-f85e-46ea-aa45-c27e60b4dba9 req-fc155461-667d-42b7-901b-d73b3720b7e4 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=907128185ff9473381be53050d202838&device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 1096 time: 0.2296119 Nov 24 11:15:28.531807 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-03bfbd32-7993-4cc0-9c84-837608c7742e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.661341 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5d0b2d3-3cbf-43aa-9c14-a2dcdcc4a2af req-3fb7af43-ab17-4c16-b836-60eb0bfa4cbb tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:28.678019 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b5d0b2d3-3cbf-43aa-9c14-a2dcdcc4a2af req-3fb7af43-ab17-4c16-b836-60eb0bfa4cbb tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 943 time: 0.1229122 Nov 24 11:15:28.773664 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-3e6f20e6-f548-46ac-bf53-31e6c0e6b91e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:28.781060 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-3e6f20e6-f548-46ac-bf53-31e6c0e6b91e service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 1097 time: 0.1449566 Nov 24 11:15:28.781295 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b5d0b2d3-3cbf-43aa-9c14-a2dcdcc4a2af req-a0ca0568-cf22-41ff-a1d7-16675ae30a7c tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1001656 Nov 24 11:15:28.799395 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-03bfbd32-7993-4cc0-9c84-837608c7742e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.802536 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-03bfbd32-7993-4cc0-9c84-837608c7742e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:28.803823 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-03bfbd32-7993-4cc0-9c84-837608c7742e admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/c6b6a99e-4cbe-4e87-b879-ad4a18104eb6 HTTP/1.1" status: 204 len: 168 time: 0.4057910 Nov 24 11:15:28.817388 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03bfbd32-7993-4cc0-9c84-837608c7742e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c6b6a99e-4cbe-4e87-b879-ad4a18104eb6,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:28.860484 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-47d7eef4-83af-47b1-8aff-70a3556532e0 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 HTTP/1.1" status: 200 len: 217 time: 0.0750427 Nov 24 11:15:28.870629 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c06b73cc-f85e-46ea-aa45-c27e60b4dba9 req-64ed2224-c8a8-4d2b-92d7-6dc17b6fb1af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:28.870629 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c06b73cc-f85e-46ea-aa45-c27e60b4dba9 req-64ed2224-c8a8-4d2b-92d7-6dc17b6fb1af service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=907128185ff9473381be53050d202838&shared=False HTTP/1.1" status: 200 len: 913 time: 0.3309815 Nov 24 11:15:28.985443 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-04b2d9a8-8e7e-40b7-bc6f-9c1ae3e3c937 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:28.987062 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-04b2d9a8-8e7e-40b7-bc6f-9c1ae3e3c937 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=5eae2e87-935a-45b7-89da-586ce04ad644 HTTP/1.1" status: 200 len: 856 time: 0.1196661 Nov 24 11:15:29.001402 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-195814ea-8057-4120-ba36-76ea441739e7 req-49ba2c32-cdab-449d-9895-4f6012c85a9e tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:29.004740 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-195814ea-8057-4120-ba36-76ea441739e7 req-49ba2c32-cdab-449d-9895-4f6012c85a9e tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 943 time: 0.0826859 Nov 24 11:15:29.046700 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c06b73cc-f85e-46ea-aa45-c27e60b4dba9 req-8beca61e-764a-4d43-9a3c-2ae43b3ae4ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:29.048182 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c06b73cc-f85e-46ea-aa45-c27e60b4dba9 req-8beca61e-764a-4d43-9a3c-2ae43b3ae4ec service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1644318 Nov 24 11:15:29.060347 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-195814ea-8057-4120-ba36-76ea441739e7 req-8f139c92-1469-4a10-99bc-0ed88e125b8d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477319 Nov 24 11:15:29.081474 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-8334a27b-1181-44eb-bea8-6bc9b2b8a47e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:29.083121 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-8334a27b-1181-44eb-bea8-6bc9b2b8a47e service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=76fcee22-81e5-4608-a546-3b68c56c5ac7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0886753 Nov 24 11:15:29.187815 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a9315a6-7e62-4624-b516-4dd6398dafab req-38f5d5d9-c4eb-48ac-8d2d-8798715fa888 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:29.195989 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7a9315a6-7e62-4624-b516-4dd6398dafab req-38f5d5d9-c4eb-48ac-8d2d-8798715fa888 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 943 time: 0.0660889 Nov 24 11:15:29.231400 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-dc667b56-a468-41b0-b0ea-3b8eff4853a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:29.232887 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-dc667b56-a468-41b0-b0ea-3b8eff4853a2 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=907128185ff9473381be53050d202838&device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 1096 time: 0.1318974 Nov 24 11:15:29.256399 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-1d5f95d9-42c2-4147-aba8-e558bbf4849f service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1645379 Nov 24 11:15:29.291655 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7a9315a6-7e62-4624-b516-4dd6398dafab req-d9f2a04e-24e8-4449-96aa-eef6df8d3b80 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0945957 Nov 24 11:15:29.302156 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-fb3b92ac-916c-4c69-9f15-146a0fabd78e service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa HTTP/1.1" status: 200 len: 217 time: 0.0579653 Nov 24 11:15:29.332784 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3742c7d-fed0-4c9f-a6dc-bd51d6adb35a req-5a33dcba-aa7d-487d-976e-0f79b559ff8c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:29.334281 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f3742c7d-fed0-4c9f-a6dc-bd51d6adb35a req-5a33dcba-aa7d-487d-976e-0f79b559ff8c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0961564 Nov 24 11:15:29.404006 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f3742c7d-fed0-4c9f-a6dc-bd51d6adb35a req-a9f5edfb-ad0a-4e2a-ad94-12954ee2450b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0606623 Nov 24 11:15:29.418318 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-19af7d52-de54-4802-b8e2-09a8babdb907 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:29.420067 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-19af7d52-de54-4802-b8e2-09a8babdb907 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c0d420cf-0b8e-4f90-a25c-9a74e1eafabb HTTP/1.1" status: 200 len: 850 time: 0.0988305 Nov 24 11:15:29.469194 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cd06a5f8-5b58-4b5c-b297-60a45b034e22 req-52251337-6ede-426d-904e-824839aaa2ea service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1758506 Nov 24 11:15:29.482848 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-286258b5-1a6d-4753-bf4f-aedb5c6ef8f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:29.484662 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-286258b5-1a6d-4753-bf4f-aedb5c6ef8f8 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=d9d87ca8-7863-48a6-937c-ee712996776e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0559738 Nov 24 11:15:29.590925 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-b1e467bb-3b70-4404-8a57-1ec480b9ed67 service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0965440 Nov 24 11:15:29.606373 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53524) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:29.639478 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-94ef0921-2ed7-4537-a58c-e5306ff825ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:29.639710 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 1c0adb45-b280-450a-b0f3-3c1f7c926920 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:15:29.806782 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-94ef0921-2ed7-4537-a58c-e5306ff825ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:29.824975 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15030b08-8997-4f2a-86a3-6f08825f2e31 req-50bce1f6-9122-4477-aebe-0c9a82912377 service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2262964 Nov 24 11:15:29.906013 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 1c0adb45-b280-450a-b0f3-3c1f7c926920, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=1c0adb45-b280-450a-b0f3-3c1f7c926920,segment=NetworkSegment(6c194338-e70c-49da-8985-8d59db407c63),segment_id=6c194338-e70c-49da-8985-8d59db407c63)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:29.918541 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93ce85dd-949b-409d-9115-1755b5ac6473 req-0547171b-75c3-435e-98c1-8c113214469e tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:29.920099 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-93ce85dd-949b-409d-9115-1755b5ac6473 req-0547171b-75c3-435e-98c1-8c113214469e tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 943 time: 0.0543189 Nov 24 11:15:29.924160 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-94ef0921-2ed7-4537-a58c-e5306ff825ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:29.924919 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '1c0adb45-b280-450a-b0f3-3c1f7c926920', 'network_id': '86e5ef24-6f2b-4928-b692-ecb9fd8c0b23', 'port_id': '1c0adb45-b280-450a-b0f3-3c1f7c926920', 'mac_address': 'fa:16:3e:c4:1a:fe', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1209, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '48d293f1-718f-4cda-9b6b-9bfc422e2fdd', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:15:29.975202 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:29.989865 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1c0adb45-b280-450a-b0f3-3c1f7c926920 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:15:29.995606 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-94ef0921-2ed7-4537-a58c-e5306ff825ad admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=93ca895942ba4699830e0f6350aefa3b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3855023 Nov 24 11:15:29.996003 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 53536) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:29.999354 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94ef0921-2ed7-4537-a58c-e5306ff825ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=65d79a0f-5025-4482-984d-58e9f9e4564c,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:30.035664 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-93ce85dd-949b-409d-9115-1755b5ac6473 req-0b055254-e8c5-44e5-a11a-bae51db7c036 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0945477 Nov 24 11:15:30.048718 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 1c0adb45-b280-450a-b0f3-3c1f7c926920, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=1c0adb45-b280-450a-b0f3-3c1f7c926920,segment=NetworkSegment(6c194338-e70c-49da-8985-8d59db407c63),segment_id=6c194338-e70c-49da-8985-8d59db407c63)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:30.078596 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49fcc653-0adf-4149-893e-2577aed3f296 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:30.103123 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49fcc653-0adf-4149-893e-2577aed3f296 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:30.118532 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:30.119534 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device af19a68f-fbb1-4d8c-9034-627d69f6dfd0 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:15:30.188893 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97bf727b-4023-4d9f-9cf0-ee3eac5f9ae0 req-aaa90b1f-6f03-4b7b-9044-0ca530a9e9d9 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:30.195772 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-97bf727b-4023-4d9f-9cf0-ee3eac5f9ae0 req-aaa90b1f-6f03-4b7b-9044-0ca530a9e9d9 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 943 time: 0.0629530 Nov 24 11:15:30.197648 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=1c0adb45-b280-450a-b0f3-3c1f7c926920,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:30.209632 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49fcc653-0adf-4149-893e-2577aed3f296 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:30.212325 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49fcc653-0adf-4149-893e-2577aed3f296 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:30.215772 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-49fcc653-0adf-4149-893e-2577aed3f296 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/65d79a0f-5025-4482-984d-58e9f9e4564c HTTP/1.1" status: 204 len: 168 time: 0.2164302 Nov 24 11:15:30.224101 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49fcc653-0adf-4149-893e-2577aed3f296 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=65d79a0f-5025-4482-984d-58e9f9e4564c,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:30.278906 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:15:30.280010 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-97bf727b-4023-4d9f-9cf0-ee3eac5f9ae0 req-b71599a9-768c-4b65-961a-24d296739598 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0778868 Nov 24 11:15:30.283610 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2459db7c-48c9-4d30-9cd2-a0b0de503199" -d '{"events": [{"name": "network-changed", "server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:15:30.294915 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port af19a68f-fbb1-4d8c-9034-627d69f6dfd0, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=af19a68f-fbb1-4d8c-9034-627d69f6dfd0,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:30.307840 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': 'af19a68f-fbb1-4d8c-9034-627d69f6dfd0', 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876', 'port_id': 'af19a68f-fbb1-4d8c-9034-627d69f6dfd0', 'mac_address': 'fa:16:3e:0c:bd:a2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1227, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cd868cb4-b7fb-4350-b027-a21baabac768', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:15:30.321711 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:15:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7c8485bf-7a9b-4fc6-a52c-6a2d3ae9f8ae x-openstack-request-id: req-7c8485bf-7a9b-4fc6-a52c-6a2d3ae9f8ae {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:15:30.322062 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:15:30.322427 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-7c8485bf-7a9b-4fc6-a52c-6a2d3ae9f8ae {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:15:30.322904 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'status': 'completed', 'code': 200} Nov 24 11:15:30.347730 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:30.362730 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id af19a68f-fbb1-4d8c-9034-627d69f6dfd0 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:15:30.396652 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port af19a68f-fbb1-4d8c-9034-627d69f6dfd0, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=af19a68f-fbb1-4d8c-9034-627d69f6dfd0,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:30.405314 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2459db7c-48c9-4d30-9cd2-a0b0de503199 req-3394ea7a-a3d9-4c4c-9ec7-c590b7033877 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:30.406797 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-2459db7c-48c9-4d30-9cd2-a0b0de503199 req-3394ea7a-a3d9-4c4c-9ec7-c590b7033877 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 1097 time: 0.0565364 Nov 24 11:15:30.439020 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c27a1155-252e-486c-9faa-dc55d7084acb req-c77580b0-8eb7-406e-84aa-886944c9766a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:30.442113 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c27a1155-252e-486c-9faa-dc55d7084acb req-c77580b0-8eb7-406e-84aa-886944c9766a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 943 time: 0.0656211 Nov 24 11:15:30.485421 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:30.522107 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c27a1155-252e-486c-9faa-dc55d7084acb req-c98dbb62-42f7-4fe4-88fb-15f0357fd768 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0738921 Nov 24 11:15:30.561850 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=af19a68f-fbb1-4d8c-9034-627d69f6dfd0,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:30.589623 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f48f1ec3-b16a-4cb1-97ee-6c0f999a28bc req-d8f496f1-6364-4a41-8db9-3a85e7cdfa3d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:30.590512 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f48f1ec3-b16a-4cb1-97ee-6c0f999a28bc req-d8f496f1-6364-4a41-8db9-3a85e7cdfa3d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0920012 Nov 24 11:15:30.649315 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2459db7c-48c9-4d30-9cd2-a0b0de503199 req-d9da7146-0401-4098-9868-47653ce48720 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:30.651339 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-2459db7c-48c9-4d30-9cd2-a0b0de503199 req-d9da7146-0401-4098-9868-47653ce48720 service neutron] 10.222.0.86 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 919 time: 0.2327566 Nov 24 11:15:30.656428 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f48f1ec3-b16a-4cb1-97ee-6c0f999a28bc req-d95d2efa-77cf-4414-a39a-a4c4f6926742 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0583961 Nov 24 11:15:30.711145 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-2459db7c-48c9-4d30-9cd2-a0b0de503199 req-1f66a233-e8bf-4bd7-b5ec-9398991b767b service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 HTTP/1.1" status: 200 len: 217 time: 0.0527656 Nov 24 11:15:30.790288 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2459db7c-48c9-4d30-9cd2-a0b0de503199 req-9ecea025-52d6-4993-ba2e-24fb4d3bbc70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:30.791785 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-2459db7c-48c9-4d30-9cd2-a0b0de503199 req-9ecea025-52d6-4993-ba2e-24fb4d3bbc70 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=5eae2e87-935a-45b7-89da-586ce04ad644 HTTP/1.1" status: 200 len: 856 time: 0.0722933 Nov 24 11:15:30.813709 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['af19a68f-fbb1-4d8c-9034-627d69f6dfd0'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:15:30.848163 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['1c0adb45-b280-450a-b0f3-3c1f7c926920'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:15:31.069411 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2459db7c-48c9-4d30-9cd2-a0b0de503199 req-8fd508c7-c5aa-4aab-9757-2783471b2a4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:31.070871 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-2459db7c-48c9-4d30-9cd2-a0b0de503199 req-8fd508c7-c5aa-4aab-9757-2783471b2a4a service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=76fcee22-81e5-4608-a546-3b68c56c5ac7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.2707496 Nov 24 11:15:31.254186 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e723971-7025-46c0-beb8-3a4ce6f9881a req-df2fc32f-dce7-4c4e-954b-7f95a95b132a tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:31.255791 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0e723971-7025-46c0-beb8-3a4ce6f9881a req-df2fc32f-dce7-4c4e-954b-7f95a95b132a tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 944 time: 0.0852811 Nov 24 11:15:31.270732 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-2459db7c-48c9-4d30-9cd2-a0b0de503199 req-2c544c56-4540-4d1b-a0ac-dcd74dc9a38d service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1833346 Nov 24 11:15:31.335683 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0e723971-7025-46c0-beb8-3a4ce6f9881a req-97f24e03-52bc-41b0-8ebe-345b191690b6 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677638 Nov 24 11:15:31.480389 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb565595-e9f8-4e2b-ab55-fd805faf6b6c req-946f164a-46f0-4048-b2ca-76a822d790f2 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:31.482082 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fb565595-e9f8-4e2b-ab55-fd805faf6b6c req-946f164a-46f0-4048-b2ca-76a822d790f2 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 944 time: 0.0827303 Nov 24 11:15:31.495504 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-2459db7c-48c9-4d30-9cd2-a0b0de503199 req-ae73b696-f09a-4726-a3b4-154f19c316cd service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2168596 Nov 24 11:15:31.548547 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fb565595-e9f8-4e2b-ab55-fd805faf6b6c req-f6e0caee-d0a3-4011-ae1f-5564592a4f2f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568476 Nov 24 11:15:31.614790 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 1c0adb45-b280-450a-b0f3-3c1f7c926920 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:15:31.661261 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43ba281-772d-44cc-9142-7c8936d97899 req-0e88eac8-aba7-4daf-9ac7-90e407528ac7 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:31.662783 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d43ba281-772d-44cc-9142-7c8936d97899 req-0e88eac8-aba7-4daf-9ac7-90e407528ac7 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 943 time: 0.0604236 Nov 24 11:15:31.722852 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d43ba281-772d-44cc-9142-7c8936d97899 req-8b52b7ad-d952-402e-b45d-02fa90d5f41d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531287 Nov 24 11:15:31.735763 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 1c0adb45-b280-450a-b0f3-3c1f7c926920 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:15:31.744759 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 1c0adb45-b280-450a-b0f3-3c1f7c926920 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:31.745405 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:31.825813 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eeece2c-20d0-4cfb-9f17-9239a3ffb2a5 req-6a1829b3-9b53-4179-95b1-4318cd70c89a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:31.838690 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5eeece2c-20d0-4cfb-9f17-9239a3ffb2a5 req-6a1829b3-9b53-4179-95b1-4318cd70c89a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0638762 Nov 24 11:15:31.850204 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:31.874707 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ed7b28e1-4fea-4e73-abbc-496e22238856', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1c0adb45-b280-450a-b0f3-3c1f7c926920'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:15:31.885054 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5eeece2c-20d0-4cfb-9f17-9239a3ffb2a5 req-4b8ff845-f49f-461f-a9d6-94a0823f7f07 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454979 Nov 24 11:15:31.948590 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 1c0adb45-b280-450a-b0f3-3c1f7c926920, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=1c0adb45-b280-450a-b0f3-3c1f7c926920,segment=NetworkSegment(6c194338-e70c-49da-8985-8d59db407c63),segment_id=6c194338-e70c-49da-8985-8d59db407c63)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:32.015725 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:32.016805 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device af19a68f-fbb1-4d8c-9034-627d69f6dfd0 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:15:32.063085 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-450dc344-ac18-4706-be21-2347d6d975ca" -d '{"events": [{"server_uuid": "ed7b28e1-4fea-4e73-abbc-496e22238856", "name": "network-vif-plugged", "status": "completed", "tag": "1c0adb45-b280-450a-b0f3-3c1f7c926920"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:15:32.104930 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=1c0adb45-b280-450a-b0f3-3c1f7c926920,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:32.155382 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:15:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32e3f49b-c876-4ef6-b6f3-eb73193aeda5 x-openstack-request-id: req-32e3f49b-c876-4ef6-b6f3-eb73193aeda5 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:15:32.155674 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ed7b28e1-4fea-4e73-abbc-496e22238856", "name": "network-vif-plugged", "status": "completed", "tag": "1c0adb45-b280-450a-b0f3-3c1f7c926920", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:15:32.155927 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-32e3f49b-c876-4ef6-b6f3-eb73193aeda5 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:15:32.156387 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ed7b28e1-4fea-4e73-abbc-496e22238856', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1c0adb45-b280-450a-b0f3-3c1f7c926920', 'code': 200} Nov 24 11:15:32.238807 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port af19a68f-fbb1-4d8c-9034-627d69f6dfd0 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:15:32.242904 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port af19a68f-fbb1-4d8c-9034-627d69f6dfd0 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:32.244306 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:32.327608 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:32.360090 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port af19a68f-fbb1-4d8c-9034-627d69f6dfd0, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=af19a68f-fbb1-4d8c-9034-627d69f6dfd0,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:32.457207 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20496a6d-324b-44b8-a9ee-549673caeb0a req-06e0616a-7fc6-474f-b332-987c97f6f641 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:32.458981 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-20496a6d-324b-44b8-a9ee-549673caeb0a req-06e0616a-7fc6-474f-b332-987c97f6f641 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 945 time: 0.0592360 Nov 24 11:15:32.461277 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:32.520680 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-20496a6d-324b-44b8-a9ee-549673caeb0a req-fc0646eb-d8fa-4bcf-98e3-a61049dcb8be tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0532310 Nov 24 11:15:32.550951 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5144a022-ae36-4f4e-89ef-2e361fec96b0 req-8364c491-f6b1-4d37-b5c6-aee5dc1f92b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:32.554330 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5144a022-ae36-4f4e-89ef-2e361fec96b0 req-8364c491-f6b1-4d37-b5c6-aee5dc1f92b7 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 1098 time: 0.1146142 Nov 24 11:15:32.554449 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=af19a68f-fbb1-4d8c-9034-627d69f6dfd0,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:32.581945 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5144a022-ae36-4f4e-89ef-2e361fec96b0 req-5bdb8a16-b0fe-4957-beb8-a857fa07d34a service neutron] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:32.667847 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5144a022-ae36-4f4e-89ef-2e361fec96b0 req-5bdb8a16-b0fe-4957-beb8-a857fa07d34a service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:32.683469 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2259de11-2752-4422-bf0b-791b308616ae req-1f3b0680-68cf-4f89-8b1e-9bfef5f56f5d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:32.685039 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2259de11-2752-4422-bf0b-791b308616ae req-1f3b0680-68cf-4f89-8b1e-9bfef5f56f5d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 945 time: 0.0534430 Nov 24 11:15:32.735446 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5144a022-ae36-4f4e-89ef-2e361fec96b0 req-5bdb8a16-b0fe-4957-beb8-a857fa07d34a service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:32.739344 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2259de11-2752-4422-bf0b-791b308616ae req-bcacebe5-d9e3-4436-9615-f44c7767d5ca tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457983 Nov 24 11:15:32.800135 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5144a022-ae36-4f4e-89ef-2e361fec96b0 req-5bdb8a16-b0fe-4957-beb8-a857fa07d34a service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2345960 Nov 24 11:15:32.821555 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bdb8a16-b0fe-4957-beb8-a857fa07d34a service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=c68d2200-cd05-4dbc-97e2-9b19b29d8005,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:32.883497 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e3252f-8f0a-4874-9360-723752493401 req-60e61224-d71e-4285-abc3-32e644f80f64 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:32.884968 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a6e3252f-8f0a-4874-9360-723752493401 req-60e61224-d71e-4285-abc3-32e644f80f64 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 943 time: 0.0509155 Nov 24 11:15:32.946759 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a6e3252f-8f0a-4874-9360-723752493401 req-1e652158-c879-407e-9825-f1a38fba1ca1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0558887 Nov 24 11:15:33.038931 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ebfb6fb-214e-4329-a1a5-426066c8f00c req-b397b8cd-a3ba-4e8a-a1ff-8ff31306255e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:33.040595 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0ebfb6fb-214e-4329-a1a5-426066c8f00c req-b397b8cd-a3ba-4e8a-a1ff-8ff31306255e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0623982 Nov 24 11:15:33.098763 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0ebfb6fb-214e-4329-a1a5-426066c8f00c req-fd1ea51d-5525-4940-9525-6615f02de297 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466974 Nov 24 11:15:33.630381 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:15:33.647406 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93e8be7a-908c-49a7-a7d0-f4e0b43880fb req-7188faf8-15e0-4c7b-82fa-44d1727df99b tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:33.651795 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-93e8be7a-908c-49a7-a7d0-f4e0b43880fb req-7188faf8-15e0-4c7b-82fa-44d1727df99b tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 945 time: 0.0546350 Nov 24 11:15:33.709628 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-93e8be7a-908c-49a7-a7d0-f4e0b43880fb req-aac83d2a-2988-4acc-ad55-a540cb43b567 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537913 Nov 24 11:15:33.730443 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:33.746317 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'port_id': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'mac_address': 'fa:16:3e:ec:fd:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1229, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:15:33.792336 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:33.807660 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:15:33.828868 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:33.872587 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ce0d4c-505b-4ad3-b2dc-b39d391eced5 req-66c9878d-66e4-49ca-a3d7-703fe76066f5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:33.874134 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-68ce0d4c-505b-4ad3-b2dc-b39d391eced5 req-66c9878d-66e4-49ca-a3d7-703fe76066f5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 945 time: 0.0561023 Nov 24 11:15:33.919482 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:33.920235 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:15:33.947689 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-68ce0d4c-505b-4ad3-b2dc-b39d391eced5 req-a8619f2a-0cf2-49a1-97b7-43054e47b01c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656824 Nov 24 11:15:33.997115 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:34.073453 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a928b3a6-58ab-437b-9d83-70821dd7d07a req-175a071b-bb7d-476e-97d9-38d19f4f1f83 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:34.075607 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a928b3a6-58ab-437b-9d83-70821dd7d07a req-175a071b-bb7d-476e-97d9-38d19f4f1f83 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 943 time: 0.0535269 Nov 24 11:15:34.077540 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:34.091900 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'port_id': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa', 'mac_address': 'fa:16:3e:e5:d8:4b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1216, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:15:34.131194 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a928b3a6-58ab-437b-9d83-70821dd7d07a req-5c6f8272-90e8-41e9-b6f3-c0780ab30c69 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481291 Nov 24 11:15:34.134332 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:34.149232 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:15:34.157141 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b4304784-90ed-4c3d-8dfe-c9e1397abf4d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'af19a68f-fbb1-4d8c-9034-627d69f6dfd0'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:15:34.160344 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a6399991-d80c-4531-9eb3-fea255718fa1" -d '{"events": [{"server_uuid": "b4304784-90ed-4c3d-8dfe-c9e1397abf4d", "name": "network-vif-plugged", "status": "completed", "tag": "af19a68f-fbb1-4d8c-9034-627d69f6dfd0"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:15:34.183189 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:34.210027 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:15:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aba54a2d-56e5-407c-ae10-a46ff7fe46cd x-openstack-request-id: req-aba54a2d-56e5-407c-ae10-a46ff7fe46cd {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:15:34.210340 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b4304784-90ed-4c3d-8dfe-c9e1397abf4d", "name": "network-vif-plugged", "status": "completed", "tag": "af19a68f-fbb1-4d8c-9034-627d69f6dfd0", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:15:34.210648 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-aba54a2d-56e5-407c-ae10-a46ff7fe46cd {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:15:34.211045 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b4304784-90ed-4c3d-8dfe-c9e1397abf4d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'af19a68f-fbb1-4d8c-9034-627d69f6dfd0', 'code': 200} Nov 24 11:15:34.250576 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff68faff-5809-4076-87c7-227210e51ad6 req-8f6fbd9f-a236-4421-8bd2-620f82821a34 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:34.252773 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff68faff-5809-4076-87c7-227210e51ad6 req-8f6fbd9f-a236-4421-8bd2-620f82821a34 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.0586176 Nov 24 11:15:34.289695 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:34.304786 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff68faff-5809-4076-87c7-227210e51ad6 req-4facf285-84ee-4f22-a630-de984ff10411 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459220 Nov 24 11:15:34.339728 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:34.625442 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-591f2a77-e1e1-4cf0-8614-e7ce76baab87 req-b58a274d-5502-46a6-8f8f-8352b318b75d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:34.627674 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-591f2a77-e1e1-4cf0-8614-e7ce76baab87 req-b58a274d-5502-46a6-8f8f-8352b318b75d service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 1098 time: 0.0705822 Nov 24 11:15:34.635070 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['ebbec69a-2982-4fe3-b07d-5326d6b7f5f3'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:15:34.637462 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:15:34.697339 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-591f2a77-e1e1-4cf0-8614-e7ce76baab87 req-56d1fe18-6ba9-4ce8-9e7a-129edbe01a11 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0605867 Nov 24 11:15:34.899246 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c79bda-3ebd-4d7c-ae07-debbd93fd913 req-4edb877e-eb2a-473a-832c-a71f63ac0e0a tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:34.900800 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-87c79bda-3ebd-4d7c-ae07-debbd93fd913 req-4edb877e-eb2a-473a-832c-a71f63ac0e0a tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 945 time: 0.0726860 Nov 24 11:15:34.955808 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-87c79bda-3ebd-4d7c-ae07-debbd93fd913 req-a1d0fdcb-03a4-4547-88bb-44b7df8bd0f7 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485518 Nov 24 11:15:35.053485 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:15:35.068904 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-969ccd3f-bd10-471f-9c53-c5798c69ff11 req-bd0bb6b9-7827-430d-a48a-1b6da98f3322 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:35.070637 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-969ccd3f-bd10-471f-9c53-c5798c69ff11 req-bd0bb6b9-7827-430d-a48a-1b6da98f3322 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 945 time: 0.0495913 Nov 24 11:15:35.123113 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-969ccd3f-bd10-471f-9c53-c5798c69ff11 req-03b5b1d3-c0e3-4445-9d1a-e8bed3a10111 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458810 Nov 24 11:15:35.258560 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5482299d-a5f0-4ea0-b15b-4656119be693 req-1ddfc792-ca41-45ee-a813-3750d3bd3ecc tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:35.260644 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5482299d-a5f0-4ea0-b15b-4656119be693 req-1ddfc792-ca41-45ee-a813-3750d3bd3ecc tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 944 time: 0.0499425 Nov 24 11:15:35.313249 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5482299d-a5f0-4ea0-b15b-4656119be693 req-94f29033-8637-4598-98be-4f6ce7909c33 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463641 Nov 24 11:15:35.422953 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-016ac65b-9aac-43b0-907e-d5dc1a559a0b req-240a0e1e-653a-443a-b57f-4c8c1708e534 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:35.425147 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-016ac65b-9aac-43b0-907e-d5dc1a559a0b req-240a0e1e-653a-443a-b57f-4c8c1708e534 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.0493016 Nov 24 11:15:35.471307 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-016ac65b-9aac-43b0-907e-d5dc1a559a0b req-3f6698a7-42e5-4dbb-813e-ef6dc3f1b276 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401027 Nov 24 11:15:36.239762 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9b43fb-dc72-4bae-85b0-6e5a6edf222f req-f3a9289f-2387-4ac1-a7d2-ebdcdbf7bcff tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:36.241204 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3e9b43fb-dc72-4bae-85b0-6e5a6edf222f req-f3a9289f-2387-4ac1-a7d2-ebdcdbf7bcff tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 945 time: 0.0514696 Nov 24 11:15:36.287712 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3e9b43fb-dc72-4bae-85b0-6e5a6edf222f req-ad9802c5-48f2-44e9-b6ed-2801d9918d5f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405807 Nov 24 11:15:36.429260 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2275abf5-a9d3-47e3-8987-6413e0335cb2 req-40e2d009-6f7f-43e7-a80c-b0a9a768d4c7 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:36.430638 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2275abf5-a9d3-47e3-8987-6413e0335cb2 req-40e2d009-6f7f-43e7-a80c-b0a9a768d4c7 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 944 time: 0.0485990 Nov 24 11:15:36.477400 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2275abf5-a9d3-47e3-8987-6413e0335cb2 req-92fa3a3c-8319-4711-852f-e9a591b5f204 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407698 Nov 24 11:15:36.586528 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fdde1a3-f49f-47ce-8152-520340cf375e req-63a2f39d-76e0-4555-a830-a36490b308bb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:36.588007 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5fdde1a3-f49f-47ce-8152-520340cf375e req-63a2f39d-76e0-4555-a830-a36490b308bb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.0478201 Nov 24 11:15:36.638010 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5fdde1a3-f49f-47ce-8152-520340cf375e req-7313a921-14e2-4148-a322-3b084301d089 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437944 Nov 24 11:15:37.401017 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45caff78-6fae-49ca-a49b-1ff9a87c94bf req-e04a70af-910c-4c4d-9017-c69d838dfe90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:37.402465 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-45caff78-6fae-49ca-a49b-1ff9a87c94bf req-e04a70af-910c-4c4d-9017-c69d838dfe90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 945 time: 0.0500402 Nov 24 11:15:37.451082 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-45caff78-6fae-49ca-a49b-1ff9a87c94bf req-217b6f74-9529-415c-ae9b-5ec1087e9d06 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415270 Nov 24 11:15:37.590094 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b92ed6f3-8ea4-443d-8564-ddecfc1e8aa8 req-2a7a424e-6813-4c84-85f8-717b3187c1c5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:37.591555 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b92ed6f3-8ea4-443d-8564-ddecfc1e8aa8 req-2a7a424e-6813-4c84-85f8-717b3187c1c5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 944 time: 0.0478356 Nov 24 11:15:37.637952 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b92ed6f3-8ea4-443d-8564-ddecfc1e8aa8 req-dd204765-59bb-4ac1-95bb-bd48bc2e82ae tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396523 Nov 24 11:15:37.759307 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d1f67b-53b7-4fac-9c16-542cb5be6e90 req-19cdc446-1f6d-47e8-80aa-09e975c56b62 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:37.760787 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-75d1f67b-53b7-4fac-9c16-542cb5be6e90 req-19cdc446-1f6d-47e8-80aa-09e975c56b62 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.0528195 Nov 24 11:15:37.811733 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-75d1f67b-53b7-4fac-9c16-542cb5be6e90 req-eba61435-e577-46b0-a7d5-112306ddeeb6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449762 Nov 24 11:15:38.580489 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff9fbceb-2601-454a-8c38-670b0b73da6b req-0768df81-62cf-41ba-a972-fec53124b307 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:38.581959 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff9fbceb-2601-454a-8c38-670b0b73da6b req-0768df81-62cf-41ba-a972-fec53124b307 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 945 time: 0.0540435 Nov 24 11:15:38.648088 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff9fbceb-2601-454a-8c38-670b0b73da6b req-e601f507-f755-4dc2-80d0-7c52df33d48a tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602283 Nov 24 11:15:38.746596 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b8d6922c-493b-4a95-809a-757d7c66e074 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:38.766369 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-638edb13-747b-419b-ac11-d4ad3e4e11a7 req-254b357e-a3b6-448c-9035-96dcc08dea52 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:38.773395 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-638edb13-747b-419b-ac11-d4ad3e4e11a7 req-254b357e-a3b6-448c-9035-96dcc08dea52 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 944 time: 0.0610898 Nov 24 11:15:38.823616 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-638edb13-747b-419b-ac11-d4ad3e4e11a7 req-c627a75b-69d9-4edd-a513-5c8c15338393 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490677 Nov 24 11:15:38.940396 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54fdb48-78dc-4480-ad91-590cc0e7a11a req-81098309-3c00-4577-a950-2c97f78263d8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:38.942166 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f54fdb48-78dc-4480-ad91-590cc0e7a11a req-81098309-3c00-4577-a950-2c97f78263d8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.0573862 Nov 24 11:15:39.002958 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f54fdb48-78dc-4480-ad91-590cc0e7a11a req-9d4858ed-6596-46fb-8e31-9727919261fa tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0528336 Nov 24 11:15:39.118172 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:39.773799 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8185e263-8b6c-4f16-949b-7c24e66ab149 req-5a999049-57ef-4298-9dcc-435b0d003021 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:39.773799 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8185e263-8b6c-4f16-949b-7c24e66ab149 req-5a999049-57ef-4298-9dcc-435b0d003021 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 945 time: 0.0529866 Nov 24 11:15:39.824404 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8185e263-8b6c-4f16-949b-7c24e66ab149 req-2037d089-3365-42c7-800b-9553506652ec tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435772 Nov 24 11:15:39.948153 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3540eb85-472a-4883-bec4-86ac16c0ef0f req-43c226d5-6b76-4f2c-a82f-e03f49f0bf19 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:39.949591 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3540eb85-472a-4883-bec4-86ac16c0ef0f req-43c226d5-6b76-4f2c-a82f-e03f49f0bf19 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 944 time: 0.0522790 Nov 24 11:15:39.999254 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3540eb85-472a-4883-bec4-86ac16c0ef0f req-9e22a4aa-afb6-4b4c-8c9b-84662fbb8e02 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431254 Nov 24 11:15:40.141460 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aecb267-9f3b-4983-afc7-befe4c6c3fbc req-7321a257-9eac-44ba-bdae-3adc980df764 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:40.143271 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0aecb267-9f3b-4983-afc7-befe4c6c3fbc req-7321a257-9eac-44ba-bdae-3adc980df764 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.0556459 Nov 24 11:15:40.194282 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0aecb267-9f3b-4983-afc7-befe4c6c3fbc req-275811ec-396d-493e-a205-e2b8f0035bed tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435495 Nov 24 11:15:40.870540 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 53874) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:40.976756 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-449e8246-39a4-45d5-a88f-095b2ae3fbbb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.047164 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-449e8246-39a4-45d5-a88f-095b2ae3fbbb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.124903 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-449e8246-39a4-45d5-a88f-095b2ae3fbbb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.140733 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62789be8-d98c-47d5-b220-9ee96b4166bb req-3c0475c7-bcd0-4fbb-a852-0cb74723f98b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:41.142397 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-62789be8-d98c-47d5-b220-9ee96b4166bb req-3c0475c7-bcd0-4fbb-a852-0cb74723f98b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 944 time: 0.0554383 Nov 24 11:15:41.153808 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-da2f4a6e-74e5-4eeb-8117-df2f62c75717 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.171112 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-449e8246-39a4-45d5-a88f-095b2ae3fbbb admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=53ba9db99239480a89c288535685f61d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2971213 Nov 24 11:15:41.171583 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53884) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:41.175168 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-449e8246-39a4-45d5-a88f-095b2ae3fbbb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ffcc9e06-5aeb-43d6-adc3-26c67253bc9c,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:41.229472 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-62789be8-d98c-47d5-b220-9ee96b4166bb req-ff3c56b0-1500-4cbf-831a-21f4a2c0d5c2 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0788770 Nov 24 11:15:41.247088 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-616f3117-372a-4af5-a42c-deb61a2fcfc8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.252635 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:15:41.272239 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-616f3117-372a-4af5-a42c-deb61a2fcfc8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.352704 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9f4141d-2c6d-47bc-b667-16095002df12 req-6f5e2fee-51c4-4a0e-bf23-262f3126d8e3 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:41.354671 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a9f4141d-2c6d-47bc-b667-16095002df12 req-6f5e2fee-51c4-4a0e-bf23-262f3126d8e3 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.0653415 Nov 24 11:15:41.387617 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:15:41.393453 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:41.393982 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.408698 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a9f4141d-2c6d-47bc-b667-16095002df12 req-eb7a3a7c-d28d-45ed-bc5d-e30335b381d4 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476334 Nov 24 11:15:41.432577 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-616f3117-372a-4af5-a42c-deb61a2fcfc8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.435486 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-616f3117-372a-4af5-a42c-deb61a2fcfc8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.439255 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-616f3117-372a-4af5-a42c-deb61a2fcfc8 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/ffcc9e06-5aeb-43d6-adc3-26c67253bc9c HTTP/1.1" status: 204 len: 168 time: 0.2643120 Nov 24 11:15:41.448979 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-616f3117-372a-4af5-a42c-deb61a2fcfc8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ffcc9e06-5aeb-43d6-adc3-26c67253bc9c,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:41.490759 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.514955 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:15:41.517935 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d2674bd6-f83d-4ed0-ae52-495d4847a55a" -d '{"events": [{"server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "name": "network-vif-plugged", "status": "completed", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:15:41.535761 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:41.558597 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:15:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-deabc3d1-ad84-490f-b186-7ce327de2db7 x-openstack-request-id: req-deabc3d1-ad84-490f-b186-7ce327de2db7 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:15:41.558911 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "name": "network-vif-plugged", "status": "completed", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:15:41.559171 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-deabc3d1-ad84-490f-b186-7ce327de2db7 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:15:41.559602 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'code': 200} Nov 24 11:15:41.586539 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.587364 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:15:41.664664 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:41.735274 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:15:41.739350 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:15:41.739720 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.821313 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.853805 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:15:41.935186 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.945271 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 53900) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:41.958918 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-19908ceb-dd40-422d-8dc9-8cdc2faa4273 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:41.982893 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:42.035256 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-19908ceb-dd40-422d-8dc9-8cdc2faa4273 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:42.117539 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-19908ceb-dd40-422d-8dc9-8cdc2faa4273 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:42.155025 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-19908ceb-dd40-422d-8dc9-8cdc2faa4273 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=2ec66256f9e046d4bf5125f4cca2562c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2086565 Nov 24 11:15:42.156292 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19908ceb-dd40-422d-8dc9-8cdc2faa4273 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6db59536-c0aa-4200-9afd-b0a58ae37bc4,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:42.157807 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 53904) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:42.208785 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e4aa2566-80a1-4276-9484-6a21baeb9ea1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:42.229736 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e4aa2566-80a1-4276-9484-6a21baeb9ea1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:42.340728 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e4aa2566-80a1-4276-9484-6a21baeb9ea1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:42.343387 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e4aa2566-80a1-4276-9484-6a21baeb9ea1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:42.347113 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-e4aa2566-80a1-4276-9484-6a21baeb9ea1 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/6db59536-c0aa-4200-9afd-b0a58ae37bc4 HTTP/1.1" status: 204 len: 168 time: 0.1858301 Nov 24 11:15:42.348845 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf3badd-4188-4bc7-a011-0f92ff765a46 req-4c99c6b4-950e-43c3-b9d6-9870905ca08f tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:42.356881 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0bf3badd-4188-4bc7-a011-0f92ff765a46 req-4c99c6b4-950e-43c3-b9d6-9870905ca08f tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0503504 Nov 24 11:15:42.357017 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4aa2566-80a1-4276-9484-6a21baeb9ea1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6db59536-c0aa-4200-9afd-b0a58ae37bc4,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:42.407972 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0bf3badd-4188-4bc7-a011-0f92ff765a46 req-659ddefd-b742-4ece-aa68-141fd76f6005 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445220 Nov 24 11:15:42.430818 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:42.554808 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae52668f-1986-43e8-b3a7-b823b2018526 req-757d55a3-e54d-4f03-b659-28175f0eb16f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:42.556434 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ae52668f-1986-43e8-b3a7-b823b2018526 req-757d55a3-e54d-4f03-b659-28175f0eb16f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0670748 Nov 24 11:15:42.608338 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ae52668f-1986-43e8-b3a7-b823b2018526 req-2df58c31-c73a-474d-a6d4-18090757b2a2 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455930 Nov 24 11:15:43.530504 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb498bda-a62c-4ae2-8881-d54d7e825da9 req-91df0e4f-4e0b-4e09-a70a-d57c1e39ab5b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:43.539822 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fb498bda-a62c-4ae2-8881-d54d7e825da9 req-91df0e4f-4e0b-4e09-a70a-d57c1e39ab5b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0535407 Nov 24 11:15:43.545104 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bc080c2-5121-4218-bad1-9bf3ef66f5aa req-b9bc3f5d-51cc-48a1-8ce0-f2391360fe48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:43.546894 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-8bc080c2-5121-4218-bad1-9bf3ef66f5aa req-b9bc3f5d-51cc-48a1-8ce0-f2391360fe48 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 1099 time: 0.0441446 Nov 24 11:15:43.561518 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:15:43.563491 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-25e4701b-15fe-4f57-8120-250262f13d6f" -d '{"events": [{"server_uuid": "91407c11-277d-4df0-83b5-cbb8696fb8c2", "name": "network-vif-plugged", "status": "completed", "tag": "dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:15:43.607021 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-8bc080c2-5121-4218-bad1-9bf3ef66f5aa req-49df17c0-f277-49e9-90d1-906dab8756f0 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0508687 Nov 24 11:15:43.613625 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fb498bda-a62c-4ae2-8881-d54d7e825da9 req-0ec4bb2c-2996-4724-af01-d459b644860a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0726566 Nov 24 11:15:43.632855 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:15:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0c75e6e0-a2f3-45e3-a76b-53cd3dfbc073 x-openstack-request-id: req-0c75e6e0-a2f3-45e3-a76b-53cd3dfbc073 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:15:43.633156 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "91407c11-277d-4df0-83b5-cbb8696fb8c2", "name": "network-vif-plugged", "status": "completed", "tag": "dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:15:43.633413 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-0c75e6e0-a2f3-45e3-a76b-53cd3dfbc073 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:15:43.633806 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa', 'code': 200} Nov 24 11:15:43.750015 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b481e1-7391-4ba4-8e34-02ee9bda5dcf req-77e21168-cd50-4562-bf11-6b0a70096684 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:43.751508 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-12b481e1-7391-4ba4-8e34-02ee9bda5dcf req-77e21168-cd50-4562-bf11-6b0a70096684 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0545547 Nov 24 11:15:43.803611 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-12b481e1-7391-4ba4-8e34-02ee9bda5dcf req-6e12ee40-028b-4ca1-a6df-7ffb9759b167 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451119 Nov 24 11:15:44.005528 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:44.166382 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af6dab39-1f69-4931-898a-196ab885377f req-8d672e46-6ea7-4158-8c61-57b4fc8066c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:44.168394 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-af6dab39-1f69-4931-898a-196ab885377f req-8d672e46-6ea7-4158-8c61-57b4fc8066c1 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 1098 time: 0.0516391 Nov 24 11:15:44.221606 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-af6dab39-1f69-4931-898a-196ab885377f req-83d000c4-0530-43b8-a4aa-49623db21145 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454400 Nov 24 11:15:44.739675 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77cf3aa0-74d7-43ec-adff-927ae9383a3d req-3ed8c832-8d2c-4ab4-802b-c13e26c2e568 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:44.741602 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-77cf3aa0-74d7-43ec-adff-927ae9383a3d req-3ed8c832-8d2c-4ab4-802b-c13e26c2e568 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0607760 Nov 24 11:15:44.798239 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-77cf3aa0-74d7-43ec-adff-927ae9383a3d req-8b5b7d6c-cd52-47ba-a84f-9496291a97ef tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497394 Nov 24 11:15:44.815030 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:44.939369 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3d7455-713b-4e0d-8863-ea7131046094 req-efb6b1c2-3a42-4dde-bad0-dd1b4e8a6c10 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:44.941127 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5c3d7455-713b-4e0d-8863-ea7131046094 req-efb6b1c2-3a42-4dde-bad0-dd1b4e8a6c10 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0640781 Nov 24 11:15:45.009929 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5c3d7455-713b-4e0d-8863-ea7131046094 req-8f20563d-3a78-4d85-bd67-92623be30045 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0565951 Nov 24 11:15:45.399740 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54048) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:45.509102 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f069fd26-26c6-4439-9732-264d32157c4f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:45.586553 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f069fd26-26c6-4439-9732-264d32157c4f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:45.730515 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f069fd26-26c6-4439-9732-264d32157c4f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:45.775206 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f069fd26-26c6-4439-9732-264d32157c4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=32f71a16-a832-4fbd-8e9d-edbac00f399c,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:45.779468 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-f069fd26-26c6-4439-9732-264d32157c4f admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=c3d017d8315f4a65b57279ef766c9dac&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3786838 Nov 24 11:15:45.782213 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54056) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:45.834922 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-86480365-d235-44ff-8392-b0e665ae637e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:45.863007 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-86480365-d235-44ff-8392-b0e665ae637e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:45.916768 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af225d0-5d14-4a31-9bba-3f92f73f5b49 req-db6b9fce-2740-47a3-864c-7d86d9d343c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:45.918161 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3af225d0-5d14-4a31-9bba-3f92f73f5b49 req-db6b9fce-2740-47a3-864c-7d86d9d343c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0485253 Nov 24 11:15:45.968460 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3af225d0-5d14-4a31-9bba-3f92f73f5b49 req-5e7f6fa9-ac5b-4f8d-a91d-482e5ba3d9d4 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439992 Nov 24 11:15:45.975454 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-86480365-d235-44ff-8392-b0e665ae637e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:45.978040 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-86480365-d235-44ff-8392-b0e665ae637e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:45.979285 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-86480365-d235-44ff-8392-b0e665ae637e admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/32f71a16-a832-4fbd-8e9d-edbac00f399c HTTP/1.1" status: 204 len: 168 time: 0.1961484 Nov 24 11:15:45.993718 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86480365-d235-44ff-8392-b0e665ae637e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32f71a16-a832-4fbd-8e9d-edbac00f399c,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:46.134696 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d478ae8-b21e-46bf-a844-98e2f7029083 req-088adb52-29ff-469b-a86e-01314daa7352 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:46.136239 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3d478ae8-b21e-46bf-a844-98e2f7029083 req-088adb52-29ff-469b-a86e-01314daa7352 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0522861 Nov 24 11:15:46.184628 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3d478ae8-b21e-46bf-a844-98e2f7029083 req-f0e88649-02d3-43ed-b2ac-9debe52669bb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424387 Nov 24 11:15:46.351021 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a6a12e-4087-457f-af9f-64d592d16120 req-1a51a68f-0474-4d22-a8c6-14e2dff1165d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:46.352572 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e4a6a12e-4087-457f-af9f-64d592d16120 req-1a51a68f-0474-4d22-a8c6-14e2dff1165d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0561674 Nov 24 11:15:46.361490 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54072) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:46.366275 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-60832e21-2c08-4794-8e75-347290dae665 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Request body: {'floatingip': {'port_id': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:46.440366 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-60832e21-2c08-4794-8e75-347290dae665 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:46.511566 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54082) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:46.525179 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6143eca0-1452-48da-9ee1-e3019ad46115 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:46.610765 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6143eca0-1452-48da-9ee1-e3019ad46115 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:46.666357 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6143eca0-1452-48da-9ee1-e3019ad46115 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:46.713782 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-6143eca0-1452-48da-9ee1-e3019ad46115 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=c1c7ea25cee8472a88bf4e2aea16413a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2009413 Nov 24 11:15:46.714430 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6143eca0-1452-48da-9ee1-e3019ad46115 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da53d89d-2b12-41b2-a32e-8cfb6719877c,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:46.717131 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54090) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:46.965765 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cf9a9698-6c2e-4167-951a-98a42e09ef36 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:47.024642 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cf9a9698-6c2e-4167-951a-98a42e09ef36 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:47.086785 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f00d2d-6fa5-4f8c-8e99-c9bb51254a0f req-7b634994-98a4-4a83-bd99-d43cfa8f1486 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:47.088289 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-05f00d2d-6fa5-4f8c-8e99-c9bb51254a0f req-7b634994-98a4-4a83-bd99-d43cfa8f1486 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0510130 Nov 24 11:15:47.146781 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-05f00d2d-6fa5-4f8c-8e99-c9bb51254a0f req-f01f4009-4d47-4891-90e2-c2ca2d535623 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0525880 Nov 24 11:15:47.216227 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-60832e21-2c08-4794-8e75-347290dae665 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:47.255315 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cf9a9698-6c2e-4167-951a-98a42e09ef36 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:47.258244 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cf9a9698-6c2e-4167-951a-98a42e09ef36 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:47.259512 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-cf9a9698-6c2e-4167-951a-98a42e09ef36 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/da53d89d-2b12-41b2-a32e-8cfb6719877c HTTP/1.1" status: 204 len: 168 time: 0.5409126 Nov 24 11:15:47.268432 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9a9698-6c2e-4167-951a-98a42e09ef36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da53d89d-2b12-41b2-a32e-8cfb6719877c,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:47.271796 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22c1c47e-25d3-47b9-8d64-09fb577e7c5f req-1ff268ca-a50f-48c4-94d0-1c545efd1430 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:47.273389 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-22c1c47e-25d3-47b9-8d64-09fb577e7c5f req-1ff268ca-a50f-48c4-94d0-1c545efd1430 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0573335 Nov 24 11:15:47.278610 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-60832e21-2c08-4794-8e75-347290dae665 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:47.284401 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54100) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:47.289890 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-9ed548df-035d-4db5-9925-a564b74289c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Request body: {'floatingip': {'port_id': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:15:47.367914 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9ed548df-035d-4db5-9925-a564b74289c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:47.615481 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.l3_db [None req-60832e21-2c08-4794-8e75-347290dae665 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Floating IP a4bf0df9-92c3-4e36-bb7b-b6727d3a175c associated. External IP: 172.27.3.239, port: ebbec69a-2982-4fe3-b07d-5326d6b7f5f3. Nov 24 11:15:47.864514 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-60832e21-2c08-4794-8e75-347290dae665 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Router 7bb4df85-5735-4ea8-9136-d2387a677310 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:15:47.982133 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-60832e21-2c08-4794-8e75-347290dae665 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:15:47.987515 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-60832e21-2c08-4794-8e75-347290dae665 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:48.005627 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3661b1c-b312-4794-bfbe-bc6671fb89d8 None None] Sync routers for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:15:48.018768 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-60832e21-2c08-4794-8e75-347290dae665 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "PUT /v2.0/floatingips/a4bf0df9-92c3-4e36-bb7b-b6727d3a175c HTTP/1.1" status: 200 len: 992 time: 1.6527400 Nov 24 11:15:48.018768 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:15:48.019038 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3661b1c-b312-4794-bfbe-bc6671fb89d8 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:15:48.019038 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-e3661b1c-b312-4794-bfbe-bc6671fb89d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:15:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:48.028319 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4cfc1f4-bf97-46f2-9c26-54a93165a046" -d '{"events": [{"name": "network-changed", "server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:15:48.074474 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:15:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00b1286e-b422-48ab-9842-baa484b024b9 x-openstack-request-id: req-00b1286e-b422-48ab-9842-baa484b024b9 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:15:48.075001 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:15:48.075508 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-00b1286e-b422-48ab-9842-baa484b024b9 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:15:48.076185 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'status': 'completed', 'code': 200} Nov 24 11:15:48.132076 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-e3661b1c-b312-4794-bfbe-bc6671fb89d8 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:15:48.235024 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9ed548df-035d-4db5-9925-a564b74289c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:48.397923 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9ed548df-035d-4db5-9925-a564b74289c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:48.405889 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-e3661b1c-b312-4794-bfbe-bc6671fb89d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': 'a4bf0df9-92c3-4e36-bb7b-b6727d3a175c', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'floating_ip_address': '172.27.3.239', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'port_id': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 102, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'mac_address': 'fa:16:3e:ec:fd:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54cca4b1-6845-4546-98db-5445a16b80d1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:15:08Z', 'updated_at': '2021-11-24T11:15:47Z', 'revision_number': 1, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:48.435644 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3661b1c-b312-4794-bfbe-bc6671fb89d8 None None] Checking router: 7bb4df85-5735-4ea8-9136-d2387a677310 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:15:48.444841 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3661b1c-b312-4794-bfbe-bc6671fb89d8 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:15:48.445458 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-e3661b1c-b312-4794-bfbe-bc6671fb89d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:15:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:48.502151 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.l3_db [None req-9ed548df-035d-4db5-9925-a564b74289c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Floating IP 3e91da78-5ead-425c-9124-df269603b837 associated. External IP: 172.27.3.245, port: dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa. Nov 24 11:15:48.553730 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-e3661b1c-b312-4794-bfbe-bc6671fb89d8 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:15:48.746101 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9ed548df-035d-4db5-9925-a564b74289c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:15:48.812513 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-e3661b1c-b312-4794-bfbe-bc6671fb89d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': 'a4bf0df9-92c3-4e36-bb7b-b6727d3a175c', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'floating_ip_address': '172.27.3.239', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'port_id': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 102, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'mac_address': 'fa:16:3e:ec:fd:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54cca4b1-6845-4546-98db-5445a16b80d1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:15:08Z', 'updated_at': '2021-11-24T11:15:47Z', 'revision_number': 1, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:48.845182 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3661b1c-b312-4794-bfbe-bc6671fb89d8 None None] The sync data for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi is: [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': 'a4bf0df9-92c3-4e36-bb7b-b6727d3a175c', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'floating_ip_address': '172.27.3.239', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'port_id': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 102, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'mac_address': 'fa:16:3e:ec:fd:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '54cca4b1-6845-4546-98db-5445a16b80d1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:15:08Z', 'updated_at': '2021-11-24T11:15:47Z', 'revision_number': 1, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:15:48.862562 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ed548df-035d-4db5-9925-a564b74289c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:15:48.867644 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9ed548df-035d-4db5-9925-a564b74289c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:48.874095 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72efada3-f655-41f7-9505-76ffe56d6a43 None None] Sync routers for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:15:48.897570 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72efada3-f655-41f7-9505-76ffe56d6a43 None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:15:48.898610 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-72efada3-f655-41f7-9505-76ffe56d6a43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:15:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:48.914654 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-9ed548df-035d-4db5-9925-a564b74289c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "PUT /v2.0/floatingips/3e91da78-5ead-425c-9124-df269603b837 HTTP/1.1" status: 200 len: 991 time: 1.6290128 Nov 24 11:15:48.915573 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'tag': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:15:48.919270 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-29b540e1-1ced-4c7a-9f79-4fd770d0ea19" -d '{"events": [{"name": "network-changed", "server_uuid": "91407c11-277d-4df0-83b5-cbb8696fb8c2", "tag": "dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:15:49.034573 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-72efada3-f655-41f7-9505-76ffe56d6a43 None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:15:49.148139 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54156) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:49.184704 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8b605333-6196-45bf-8564-f05724a18bf3 None None] New status for floating IP a4bf0df9-92c3-4e36-bb7b-b6727d3a175c: ACTIVE {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:15:49.309511 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9d5635dd-aefe-4899-b6ac-20ab84c3c97c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:49.352340 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-72efada3-f655-41f7-9505-76ffe56d6a43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '3e91da78-5ead-425c-9124-df269603b837', 'tenant_id': '907128185ff9473381be53050d202838', 'floating_ip_address': '172.27.3.245', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'port_id': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 121, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'mac_address': 'fa:16:3e:e5:d8:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:15:16Z', 'updated_at': '2021-11-24T11:15:48Z', 'revision_number': 1, 'project_id': '907128185ff9473381be53050d202838', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:11Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:49.380966 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72efada3-f655-41f7-9505-76ffe56d6a43 None None] Checking router: 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:15:49.390359 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-72efada3-f655-41f7-9505-76ffe56d6a43 None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:15:49.391090 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-72efada3-f655-41f7-9505-76ffe56d6a43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:15:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:49.409283 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9d5635dd-aefe-4899-b6ac-20ab84c3c97c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:49.472378 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9d5635dd-aefe-4899-b6ac-20ab84c3c97c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:49.503559 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-72efada3-f655-41f7-9505-76ffe56d6a43 None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:15:49.514852 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-9d5635dd-aefe-4899-b6ac-20ab84c3c97c admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=6b96a51da2bd4ef58edc53c76f43b664&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3655338 Nov 24 11:15:49.515585 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d5635dd-aefe-4899-b6ac-20ab84c3c97c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33aa5a65-1d74-4ec7-bc2f-2f7170c86c46,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:49.518470 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54170) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:49.582606 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ca91eb36-3fe7-4abc-a8a4-3d31c704b57c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:49.605474 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ca91eb36-3fe7-4abc-a8a4-3d31c704b57c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:49.717651 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ca91eb36-3fe7-4abc-a8a4-3d31c704b57c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:49.720472 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ca91eb36-3fe7-4abc-a8a4-3d31c704b57c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:49.724831 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-ca91eb36-3fe7-4abc-a8a4-3d31c704b57c admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/33aa5a65-1d74-4ec7-bc2f-2f7170c86c46 HTTP/1.1" status: 204 len: 168 time: 0.2023685 Nov 24 11:15:49.731010 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca91eb36-3fe7-4abc-a8a4-3d31c704b57c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33aa5a65-1d74-4ec7-bc2f-2f7170c86c46,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:49.790097 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-72efada3-f655-41f7-9505-76ffe56d6a43 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '3e91da78-5ead-425c-9124-df269603b837', 'tenant_id': '907128185ff9473381be53050d202838', 'floating_ip_address': '172.27.3.245', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'port_id': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 121, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'mac_address': 'fa:16:3e:e5:d8:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:15:16Z', 'updated_at': '2021-11-24T11:15:48Z', 'revision_number': 1, 'project_id': '907128185ff9473381be53050d202838', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:11Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:15:49.821835 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4cfc1f4-bf97-46f2-9c26-54a93165a046 req-e6c6a635-7d7b-4d63-836b-ab6cc998b7c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:49.823630 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c4cfc1f4-bf97-46f2-9c26-54a93165a046 req-e6c6a635-7d7b-4d63-836b-ab6cc998b7c1 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 1099 time: 0.0443974 Nov 24 11:15:49.824584 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-72efada3-f655-41f7-9505-76ffe56d6a43 None None] The sync data for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi is: [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '3e91da78-5ead-425c-9124-df269603b837', 'tenant_id': '907128185ff9473381be53050d202838', 'floating_ip_address': '172.27.3.245', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'port_id': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 121, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'mac_address': 'fa:16:3e:e5:d8:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:15:16Z', 'updated_at': '2021-11-24T11:15:48Z', 'revision_number': 1, 'project_id': '907128185ff9473381be53050d202838', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:11Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:15:49.835861 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:15:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4569fcd7-7e3b-4ab6-aedb-f76467fb3225 x-openstack-request-id: req-4569fcd7-7e3b-4ab6-aedb-f76467fb3225 {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:15:49.836557 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "91407c11-277d-4df0-83b5-cbb8696fb8c2", "tag": "dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:15:49.836827 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-4569fcd7-7e3b-4ab6-aedb-f76467fb3225 {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:15:49.837455 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'tag': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa', 'status': 'completed', 'code': 200} Nov 24 11:15:49.963198 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b540e1-1ced-4c7a-9f79-4fd770d0ea19 req-a1f6e449-89b1-495f-849e-670c4dde722e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:49.964774 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-29b540e1-1ced-4c7a-9f79-4fd770d0ea19 req-a1f6e449-89b1-495f-849e-670c4dde722e service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=907128185ff9473381be53050d202838&device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 1098 time: 0.0646803 Nov 24 11:15:49.975526 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4cfc1f4-bf97-46f2-9c26-54a93165a046 req-f6bbd4cf-3220-4803-b240-780659766b50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:49.977325 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c4cfc1f4-bf97-46f2-9c26-54a93165a046 req-f6bbd4cf-3220-4803-b240-780659766b50 service neutron] 10.222.0.86 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 919 time: 0.1412914 Nov 24 11:15:50.092191 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45266366-b276-4e71-a388-81c11569fbf5 None None] New status for floating IP 3e91da78-5ead-425c-9124-df269603b837: ACTIVE {{(pid=103245) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:15:50.136449 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c4cfc1f4-bf97-46f2-9c26-54a93165a046 req-85658d1b-0fa4-4983-8c4d-79073c00a880 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 HTTP/1.1" status: 200 len: 1002 time: 0.1501889 Nov 24 11:15:50.178534 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b540e1-1ced-4c7a-9f79-4fd770d0ea19 req-5e9bec79-dce7-455a-9d96-3742626f2d2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:50.180223 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-29b540e1-1ced-4c7a-9f79-4fd770d0ea19 req-5e9bec79-dce7-455a-9d96-3742626f2d2a service neutron] 10.222.0.86 "GET /v2.0/networks?id=d9d87ca8-7863-48a6-937c-ee712996776e HTTP/1.1" status: 200 len: 913 time: 0.2020359 Nov 24 11:15:50.233925 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4cfc1f4-bf97-46f2-9c26-54a93165a046 req-26dfc763-9b34-42b8-872f-473e5de08456 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:50.235416 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c4cfc1f4-bf97-46f2-9c26-54a93165a046 req-26dfc763-9b34-42b8-872f-473e5de08456 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=5eae2e87-935a-45b7-89da-586ce04ad644 HTTP/1.1" status: 200 len: 856 time: 0.0868173 Nov 24 11:15:50.298124 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-29b540e1-1ced-4c7a-9f79-4fd770d0ea19 req-8aa5f325-ab18-4e7c-8676-260a8388d794 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa HTTP/1.1" status: 200 len: 999 time: 0.1059043 Nov 24 11:15:50.317799 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4cfc1f4-bf97-46f2-9c26-54a93165a046 req-3e391e42-bb49-4629-bfb1-246c51b3c473 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:50.319286 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c4cfc1f4-bf97-46f2-9c26-54a93165a046 req-3e391e42-bb49-4629-bfb1-246c51b3c473 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=76fcee22-81e5-4608-a546-3b68c56c5ac7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0722134 Nov 24 11:15:50.409349 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b540e1-1ced-4c7a-9f79-4fd770d0ea19 req-3d7d07f3-b836-4512-85bf-da5bb74d603d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:50.410760 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-29b540e1-1ced-4c7a-9f79-4fd770d0ea19 req-3d7d07f3-b836-4512-85bf-da5bb74d603d service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c0d420cf-0b8e-4f90-a25c-9a74e1eafabb HTTP/1.1" status: 200 len: 850 time: 0.1040661 Nov 24 11:15:50.473033 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c4cfc1f4-bf97-46f2-9c26-54a93165a046 req-74f9ffde-bb7b-432c-bd12-103ffef47517 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1342537 Nov 24 11:15:50.491931 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29b540e1-1ced-4c7a-9f79-4fd770d0ea19 req-027dfd84-f7cc-4d4e-8824-3ac70e4efc2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:50.491931 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-29b540e1-1ced-4c7a-9f79-4fd770d0ea19 req-027dfd84-f7cc-4d4e-8824-3ac70e4efc2d service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=d9d87ca8-7863-48a6-937c-ee712996776e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0728493 Nov 24 11:15:50.647053 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c4cfc1f4-bf97-46f2-9c26-54a93165a046 req-ca748024-86b0-4cbe-a77d-cb4182310f42 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1667061 Nov 24 11:15:50.652512 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-29b540e1-1ced-4c7a-9f79-4fd770d0ea19 req-27763323-db47-4d37-b9cc-d87006df2e41 service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1485546 Nov 24 11:15:50.803022 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-29b540e1-1ced-4c7a-9f79-4fd770d0ea19 req-1e3c880d-2770-4b08-8674-498d21a0ffea service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1304343 Nov 24 11:15:53.597700 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54300) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:53.713914 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-508eee03-6dc1-4534-a7eb-21da9c46fecb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:53.799322 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-508eee03-6dc1-4534-a7eb-21da9c46fecb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:53.871856 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-508eee03-6dc1-4534-a7eb-21da9c46fecb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:53.890663 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b3580cb-ed5c-4633-96d0-3dd57e0c5224 req-530ef239-7cf7-4f6a-8147-6d2a4036a9d1 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:53.892885 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3b3580cb-ed5c-4633-96d0-3dd57e0c5224 req-530ef239-7cf7-4f6a-8147-6d2a4036a9d1 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 945 time: 0.0525672 Nov 24 11:15:53.910945 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-508eee03-6dc1-4534-a7eb-21da9c46fecb admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=949ad4eae6844fd7bf59523d17b67e6d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3122790 Nov 24 11:15:53.913334 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508eee03-6dc1-4534-a7eb-21da9c46fecb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56f3a0b2-959b-4881-a05b-8d1c637a7d36,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:53.915835 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54312) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:53.946209 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3b3580cb-ed5c-4633-96d0-3dd57e0c5224 req-939418ce-1668-44b9-aa51-869e08ff6dda tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467427 Nov 24 11:15:53.964991 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-36b5f37c-d237-48ef-abf9-3b12906144fe admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:53.989083 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-36b5f37c-d237-48ef-abf9-3b12906144fe admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:54.083785 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-36b5f37c-d237-48ef-abf9-3b12906144fe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:54.086356 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-36b5f37c-d237-48ef-abf9-3b12906144fe admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:54.087624 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-36b5f37c-d237-48ef-abf9-3b12906144fe admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/56f3a0b2-959b-4881-a05b-8d1c637a7d36 HTTP/1.1" status: 204 len: 168 time: 0.1710863 Nov 24 11:15:54.098043 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36b5f37c-d237-48ef-abf9-3b12906144fe admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56f3a0b2-959b-4881-a05b-8d1c637a7d36,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:54.687404 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54328) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:54.701180 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-477ee0ab-deb5-4767-b0ff-38ebe12b35ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:54.777794 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-477ee0ab-deb5-4767-b0ff-38ebe12b35ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:54.831693 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-477ee0ab-deb5-4767-b0ff-38ebe12b35ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:54.870498 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-477ee0ab-deb5-4767-b0ff-38ebe12b35ad admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=1b7130a762d745c59e0bb3fc8887a0bf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1819649 Nov 24 11:15:54.871741 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-477ee0ab-deb5-4767-b0ff-38ebe12b35ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b2bedfaa-22f0-498a-aa4d-626907cb4cf8,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:54.873191 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54330) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:54.925647 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:54.946114 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:55.043560 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:55.046193 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:55.047405 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/b2bedfaa-22f0-498a-aa4d-626907cb4cf8 HTTP/1.1" status: 204 len: 168 time: 0.1723802 Nov 24 11:15:55.056748 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b2bedfaa-22f0-498a-aa4d-626907cb4cf8,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:55.063446 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:15:55.063793 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:15:55.064661 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:15:55.065376 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:15:55.065376 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:15:55.065606 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:15:55.065939 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:15:55.066240 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:15:55.066554 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:15:55.066866 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:15:55.067166 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:15:55.067500 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3df26070-47a6-42d8-ad7b-6582c9dc8f34 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:15:55.641991 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54344) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:55.655125 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-591bbce5-b20c-46c0-b073-73881cb79c34 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:55.730545 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-591bbce5-b20c-46c0-b073-73881cb79c34 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:55.797667 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-591bbce5-b20c-46c0-b073-73881cb79c34 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:55.835022 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-591bbce5-b20c-46c0-b073-73881cb79c34 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a64f6f4-e589-4c5f-bab1-fb3fe6efeff4,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:55.839051 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-591bbce5-b20c-46c0-b073-73881cb79c34 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=2c0d430a8e804cd7809d5ee81e756541&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1956029 Nov 24 11:15:55.841782 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54348) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:15:55.888467 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a466748-2aab-413b-ae56-ee5e327374a9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:55.912084 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a466748-2aab-413b-ae56-ee5e327374a9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:56.037723 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a466748-2aab-413b-ae56-ee5e327374a9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:56.040412 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a466748-2aab-413b-ae56-ee5e327374a9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:15:56.041589 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-5a466748-2aab-413b-ae56-ee5e327374a9 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/0a64f6f4-e589-4c5f-bab1-fb3fe6efeff4 HTTP/1.1" status: 204 len: 168 time: 0.1989663 Nov 24 11:15:56.049658 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a466748-2aab-413b-ae56-ee5e327374a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a64f6f4-e589-4c5f-bab1-fb3fe6efeff4,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:15:57.619594 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-117705ea-48ff-4ee3-b123-c097b458a541 req-3eb0c080-db3c-4717-b86b-ef3c793075cc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:57.621138 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-117705ea-48ff-4ee3-b123-c097b458a541 req-3eb0c080-db3c-4717-b86b-ef3c793075cc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 945 time: 0.0502503 Nov 24 11:15:57.678395 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-117705ea-48ff-4ee3-b123-c097b458a541 req-6598981c-679e-4730-a211-aadadb4027e1 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513844 Nov 24 11:15:58.809269 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3115263d-4647-456b-9716-837479c34aba req-ad20ea1b-c8b7-470e-8fb0-20db0b5fcd59 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:58.813167 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3115263d-4647-456b-9716-837479c34aba req-ad20ea1b-c8b7-470e-8fb0-20db0b5fcd59 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 945 time: 0.0510478 Nov 24 11:15:58.869424 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3115263d-4647-456b-9716-837479c34aba req-af69dfd0-5643-4b90-9733-a0421d2fd707 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461695 Nov 24 11:15:59.705219 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1acf4469-ca17-4b10-bca5-d7d0e5eac00d req-fa141493-5935-42fb-880f-5f4deccb5a9c tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:15:59.707051 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-1acf4469-ca17-4b10-bca5-d7d0e5eac00d req-fa141493-5935-42fb-880f-5f4deccb5a9c tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.86 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 945 time: 0.0921581 Nov 24 11:15:59.852232 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-1acf4469-ca17-4b10-bca5-d7d0e5eac00d req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Deleting port 1c0adb45-b280-450a-b0f3-3c1f7c926920 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:15:59.852565 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-1acf4469-ca17-4b10-bca5-d7d0e5eac00d req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:00.212568 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-1acf4469-ca17-4b10-bca5-d7d0e5eac00d req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] For port 1c0adb45-b280-450a-b0f3-3c1f7c926920, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=1c0adb45-b280-450a-b0f3-3c1f7c926920,segment=NetworkSegment(6c194338-e70c-49da-8985-8d59db407c63),segment_id=6c194338-e70c-49da-8985-8d59db407c63)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:00.212991 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-1acf4469-ca17-4b10-bca5-d7d0e5eac00d req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:00.218243 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8715c35-ab66-4868-ae4d-3650fb2b243f req-5763aeb9-789a-4a44-9126-e78e37897f36 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:00.219756 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c8715c35-ab66-4868-ae4d-3650fb2b243f req-5763aeb9-789a-4a44-9126-e78e37897f36 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 945 time: 0.2731407 Nov 24 11:16:00.229990 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-1acf4469-ca17-4b10-bca5-d7d0e5eac00d req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Calling delete_port for 1c0adb45-b280-450a-b0f3-3c1f7c926920 owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:16:00.323924 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c8715c35-ab66-4868-ae4d-3650fb2b243f req-631cc456-6c88-4863-85f6-8717a12b5ca5 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/security-groups?id=b89c6fa0-e54d-48e4-be18-454c74244462&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0939434 Nov 24 11:16:00.358889 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-856a3f8e-928e-49be-920f-6378c1c48174 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:00.360380 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-856a3f8e-928e-49be-920f-6378c1c48174 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/networks?id=8558262b-7125-4688-a6ea-2f1d2c3b2876 HTTP/1.1" status: 200 len: 815 time: 0.1700928 Nov 24 11:16:00.376220 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-4a98fb34-f461-4ea4-b97a-4b8a4a59f595 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/quotas/fae8312f669b48b797904792401edfa4 HTTP/1.1" status: 200 len: 375 time: 0.0091941 Nov 24 11:16:00.426826 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-a97e1e8f-ea1b-4507-8f71-ea3849e16403 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0443387 Nov 24 11:16:00.494889 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-1acf4469-ca17-4b10-bca5-d7d0e5eac00d req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:00.509549 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['1c0adb45-b280-450a-b0f3-3c1f7c926920'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:16:00.527975 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-faa26d38-774b-4160-9132-7b8b6267ad11 service neutron] 10.222.0.76 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0936708 Nov 24 11:16:00.557681 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Pushing event deleted for resources: {'Port': ['ID=1c0adb45-b280-450a-b0f3-3c1f7c926920,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:00.639994 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-5a671835-fb8f-49d4-b07b-7bc9750b0b13 service neutron] 10.222.0.76 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1057210 Nov 24 11:16:00.652212 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:00.652761 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:00.653107 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:00.653447 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:00.653780 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:00.654114 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:00.654440 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:00.654932 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:00.655318 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:00.656203 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:00.659377 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:00.659377 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:00.664337 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-1acf4469-ca17-4b10-bca5-d7d0e5eac00d req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] No DVR routers for this DVR port 1c0adb45-b280-450a-b0f3-3c1f7c926920 on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:16:00.668723 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-1acf4469-ca17-4b10-bca5-d7d0e5eac00d req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:00.673233 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-1acf4469-ca17-4b10-bca5-d7d0e5eac00d req-975cafb6-b256-4271-8aec-f7781cb8bbfc tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.86 "DELETE /v2.0/ports/1c0adb45-b280-450a-b0f3-3c1f7c926920 HTTP/1.1" status: 204 len: 173 time: 0.9481738 Nov 24 11:16:00.673901 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ed7b28e1-4fea-4e73-abbc-496e22238856', 'name': 'network-vif-deleted', 'tag': '1c0adb45-b280-450a-b0f3-3c1f7c926920'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:16:00.687595 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d439ab57-06a5-4e71-92ca-dbabefac2582" -d '{"events": [{"server_uuid": "ed7b28e1-4fea-4e73-abbc-496e22238856", "name": "network-vif-deleted", "tag": "1c0adb45-b280-450a-b0f3-3c1f7c926920"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:16:00.726789 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:16:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c1da8ba1-947d-412b-bd36-e241da362af0 x-openstack-request-id: req-c1da8ba1-947d-412b-bd36-e241da362af0 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:16:00.727435 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ed7b28e1-4fea-4e73-abbc-496e22238856", "name": "network-vif-deleted", "tag": "1c0adb45-b280-450a-b0f3-3c1f7c926920", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:16:00.727435 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-c1da8ba1-947d-412b-bd36-e241da362af0 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:16:00.727772 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ed7b28e1-4fea-4e73-abbc-496e22238856', 'name': 'network-vif-deleted', 'tag': '1c0adb45-b280-450a-b0f3-3c1f7c926920', 'status': 'completed', 'code': 200} Nov 24 11:16:00.965529 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d1d71f12-9c05-4f55-85b4-6c91722be922 req-e59d4256-8e83-4c2e-85e1-d99b4a48e44a tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 210 time: 0.0270715 Nov 24 11:16:01.098791 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54528) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:01.202282 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a4b618fe-abfa-44d5-9122-f36f2e25aec0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:01.279765 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a4b618fe-abfa-44d5-9122-f36f2e25aec0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:01.374575 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a4b618fe-abfa-44d5-9122-f36f2e25aec0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:01.412388 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4b618fe-abfa-44d5-9122-f36f2e25aec0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1ebf1ac-f625-432b-83bf-0746d2bbed4b,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:01.416795 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-a4b618fe-abfa-44d5-9122-f36f2e25aec0 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=f3dd85414d8f4a13b10357eba9d2132e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3168890 Nov 24 11:16:01.419437 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54536) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:01.454929 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e3c611c3-2a3b-4190-8612-653ae2df7072 req-d20c2b96-d4e3-4dae-bc06-5b3fcd4ea134 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 210 time: 0.0545912 Nov 24 11:16:01.478218 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3777678a-d142-42e3-b334-c6023b0bce79 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:01.499945 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3777678a-d142-42e3-b334-c6023b0bce79 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:01.536314 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54540) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:01.598696 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3777678a-d142-42e3-b334-c6023b0bce79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:01.603577 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3777678a-d142-42e3-b334-c6023b0bce79 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:01.605509 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-3777678a-d142-42e3-b334-c6023b0bce79 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/a1ebf1ac-f625-432b-83bf-0746d2bbed4b HTTP/1.1" status: 204 len: 168 time: 0.1849864 Nov 24 11:16:01.617844 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3777678a-d142-42e3-b334-c6023b0bce79 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1ebf1ac-f625-432b-83bf-0746d2bbed4b,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:01.675328 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c6b90d2-fa48-4a7c-ae1d-7e1ef6bac535 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:01.755283 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c6b90d2-fa48-4a7c-ae1d-7e1ef6bac535 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:01.837192 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c6b90d2-fa48-4a7c-ae1d-7e1ef6bac535 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:01.876742 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-5c6b90d2-fa48-4a7c-ae1d-7e1ef6bac535 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=de9b830879e34304ab88444a978af0b8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3393643 Nov 24 11:16:01.877671 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c6b90d2-fa48-4a7c-ae1d-7e1ef6bac535 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1332f34f-2e0b-4975-ae92-605dbd727fe6,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:01.879829 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54550) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:01.932379 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b4318f97-b85c-4524-b9d5-55e73584b396 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:01.956426 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b4318f97-b85c-4524-b9d5-55e73584b396 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.060164 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b4318f97-b85c-4524-b9d5-55e73584b396 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.062722 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b4318f97-b85c-4524-b9d5-55e73584b396 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.063966 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-b4318f97-b85c-4524-b9d5-55e73584b396 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/1332f34f-2e0b-4975-ae92-605dbd727fe6 HTTP/1.1" status: 204 len: 168 time: 0.1831520 Nov 24 11:16:02.072540 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4318f97-b85c-4524-b9d5-55e73584b396 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1332f34f-2e0b-4975-ae92-605dbd727fe6,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:02.225508 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54562) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:02.238896 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c008d4a2-2383-4d07-a829-dfdbcbc60af2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.311640 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c008d4a2-2383-4d07-a829-dfdbcbc60af2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.357658 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c008d4a2-2383-4d07-a829-dfdbcbc60af2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.399333 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-c008d4a2-2383-4d07-a829-dfdbcbc60af2 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=12b56ddbae9a482e88898f914238fcc7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1703131 Nov 24 11:16:02.399333 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c008d4a2-2383-4d07-a829-dfdbcbc60af2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf1e0ce4-78aa-4290-b773-d5374ed9bcbc,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:02.399729 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54566) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:02.447575 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a6a09ff3-2823-401c-bdee-2fef22291628 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.469123 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a6a09ff3-2823-401c-bdee-2fef22291628 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.580961 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a6a09ff3-2823-401c-bdee-2fef22291628 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.583602 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a6a09ff3-2823-401c-bdee-2fef22291628 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.584786 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-a6a09ff3-2823-401c-bdee-2fef22291628 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/cf1e0ce4-78aa-4290-b773-d5374ed9bcbc HTTP/1.1" status: 204 len: 168 time: 0.1840696 Nov 24 11:16:02.592284 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6a09ff3-2823-401c-bdee-2fef22291628 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf1e0ce4-78aa-4290-b773-d5374ed9bcbc,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:02.653712 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54572) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:02.667351 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8f2fe6ec-1c59-49b8-810d-a5667605b99c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.746130 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8f2fe6ec-1c59-49b8-810d-a5667605b99c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.808676 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8f2fe6ec-1c59-49b8-810d-a5667605b99c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.847037 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f2fe6ec-1c59-49b8-810d-a5667605b99c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d91a71d-8a44-4099-a848-6de0796e16ce,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:02.851499 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-8f2fe6ec-1c59-49b8-810d-a5667605b99c admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=3de1b079a8ee45f19a834fc26afc9877&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1967025 Nov 24 11:16:02.854186 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54576) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:02.901468 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0cac0d6c-7536-463d-9452-73b3c675afd0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:02.922273 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0cac0d6c-7536-463d-9452-73b3c675afd0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:03.077932 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0cac0d6c-7536-463d-9452-73b3c675afd0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:03.081125 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0cac0d6c-7536-463d-9452-73b3c675afd0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:03.082632 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-0cac0d6c-7536-463d-9452-73b3c675afd0 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/9d91a71d-8a44-4099-a848-6de0796e16ce HTTP/1.1" status: 204 len: 168 time: 0.2275479 Nov 24 11:16:03.090562 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cac0d6c-7536-463d-9452-73b3c675afd0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d91a71d-8a44-4099-a848-6de0796e16ce,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:04.247757 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-75b82358-bb28-49e7-bc27-3b6b008d189b req-4322acac-ebfb-4cee-a88f-b46c1c1db440 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 210 time: 0.0270665 Nov 24 11:16:04.279778 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-36f55cd3-dc90-47fe-a843-3784299660cf req-004637e8-b643-4f40-b807-602f5fb448c6 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 210 time: 0.0288975 Nov 24 11:16:04.389436 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 1c0adb45-b280-450a-b0f3-3c1f7c926920 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:16:04.410980 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 1c0adb45-b280-450a-b0f3-3c1f7c926920 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:16:04.411343 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 1c0adb45-b280-450a-b0f3-3c1f7c926920 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:16:05.382861 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-03170a3d-4910-4eb2-8ede-c555068da593 req-0ac2dcae-e61e-4473-b2fa-edcc0ca27174 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 210 time: 0.0327902 Nov 24 11:16:05.418599 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-d599ff43-79fa-44a7-aa73-2a6a9eadbcb5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:05.420205 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-d599ff43-79fa-44a7-aa73-2a6a9eadbcb5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "GET /v2.0/networks?id=8558262b-7125-4688-a6ea-2f1d2c3b2876 HTTP/1.1" status: 200 len: 815 time: 0.1424332 Nov 24 11:16:05.437684 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e17a0a13-111e-4922-99f3-114df5f4fc19 req-f5d69ca7-5099-4558-95a7-256e40a72546 tempest-DeleteServersTestJSON-1899943766 tempest-DeleteServersTestJSON-1899943766-project] 10.222.0.76 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 210 time: 0.0320275 Nov 24 11:16:05.444784 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Request body: {'port': {'device_id': '1451c900-3066-4ab6-a01e-7abc8ed53cfc', 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876', 'admin_state_up': True, 'tenant_id': 'fae8312f669b48b797904792401edfa4'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:05.648787 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Made reservation on behalf of fae8312f669b48b797904792401edfa4 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:16:05.652379 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:05.787190 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-3bfc31bc-b255-4bc9-96d7-74f0b702d480 req-d6f43423-aef4-4b15-b18c-6d96aebbeaa5 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=ed7b28e1-4fea-4e73-abbc-496e22238856&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 210 time: 0.0467973 Nov 24 11:16:05.806604 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Allocated IP 172.20.0.10 (8558262b-7125-4688-a6ea-2f1d2c3b2876/cd868cb4-b7fb-4350-b027-a21baabac768/5e1dd2e6-fe77-43bc-98bf-f1a63705734c) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:16:05.936042 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-3bfc31bc-b255-4bc9-96d7-74f0b702d480 req-58caaf7c-4c6d-4d5a-a634-856838282931 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=1b97c43049d94ba3b99a111a9b91864d&device_id=ed7b28e1-4fea-4e73-abbc-496e22238856 HTTP/1.1" status: 200 len: 210 time: 0.0349169 Nov 24 11:16:06.068113 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-6898c532-1fc8-4705-8f04-4852d12fe633 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/networks?tenant_id=b898b9cc37224c3ab1f1d21b45ad66eb&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0397596 Nov 24 11:16:06.088419 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:06.108851 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfc31bc-b255-4bc9-96d7-74f0b702d480 req-a684102f-b790-4502-8179-a79f4fbd0605 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:06.110285 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-3bfc31bc-b255-4bc9-96d7-74f0b702d480 req-a684102f-b790-4502-8179-a79f4fbd0605 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=1b97c43049d94ba3b99a111a9b91864d&shared=False HTTP/1.1" status: 200 len: 914 time: 0.1343691 Nov 24 11:16:06.111366 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54680) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:06.227383 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bfc31bc-b255-4bc9-96d7-74f0b702d480 req-92531cd6-bcd8-45f4-bb40-764fb28ed01b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:06.228981 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-3bfc31bc-b255-4bc9-96d7-74f0b702d480 req-92531cd6-bcd8-45f4-bb40-764fb28ed01b service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1089778 Nov 24 11:16:06.238378 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:06.251463 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['af19a68f-fbb1-4d8c-9034-627d69f6dfd0'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:16:06.278475 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3fdf5a93-ed1f-4a00-963f-9b33f9915fe8 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:06.284446 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3fdf5a93-ed1f-4a00-963f-9b33f9915fe8 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2145634 Nov 24 11:16:06.293718 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Network 8558262b-7125-4688-a6ea-2f1d2c3b2876 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:16:06.297319 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:16:06.301508 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:16:06.308800 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:06.309630 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:06.317211 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-099945c3-4de4-47d6-9f89-4c5ae5d99d7f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:06.321932 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Pushing event updated for resources: {'Port': ['ID=5e1dd2e6-fe77-43bc-98bf-f1a63705734c,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:06.339373 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-8d6bbab6-698e-45d7-9a5e-76f5a7a1b6c4 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/quotas/b898b9cc37224c3ab1f1d21b45ad66eb HTTP/1.1" status: 200 len: 375 time: 0.0361757 Nov 24 11:16:06.388091 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-91925ded-3a8b-4265-8a19-caf2d2e80e53 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=b898b9cc37224c3ab1f1d21b45ad66eb&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0513499 Nov 24 11:16:06.406433 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-b2f4a4f4-0f46-458c-a0b4-6eb01e2a52a6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9672990 Nov 24 11:16:06.421289 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Request body: {'port': {'device_id': '1451c900-3066-4ab6-a01e-7abc8ed53cfc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:06.506445 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-099945c3-4de4-47d6-9f89-4c5ae5d99d7f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:06.521464 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:06.563912 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-099945c3-4de4-47d6-9f89-4c5ae5d99d7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:06.605467 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-099945c3-4de4-47d6-9f89-4c5ae5d99d7f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70afffe6-a390-4eba-82a2-cfd352c5c6ad,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:06.641654 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-099945c3-4de4-47d6-9f89-4c5ae5d99d7f admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=46c3016432e1408fae516d59330148b8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5263498 Nov 24 11:16:06.651104 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54714) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:06.687888 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe06980-cdf5-4918-a3eb-fdd5e4f0bd71 req-38f9a27c-68ae-4e5b-b44e-aef98ccaa4ff tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:06.687888 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bbe06980-cdf5-4918-a3eb-fdd5e4f0bd71 req-38f9a27c-68ae-4e5b-b44e-aef98ccaa4ff tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 932 time: 0.0629241 Nov 24 11:16:06.760718 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4eafc25c-709a-4675-baac-86c6ccce8cb7 req-82d1860e-f2b7-4145-a67b-a1b197f2329d tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 210 time: 0.0324414 Nov 24 11:16:06.814622 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bbe06980-cdf5-4918-a3eb-fdd5e4f0bd71 req-6db500ba-f8e5-474e-a2b0-4d0ac9ca64ee tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1184931 Nov 24 11:16:06.903930 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-bb984cd7-e9b0-4eba-8cfe-0821360fb246 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:06.942900 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-bb984cd7-e9b0-4eba-8cfe-0821360fb246 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:07.008719 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5e1dd2e6-fe77-43bc-98bf-f1a63705734c {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:16:07.017630 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:07.089767 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Transition to ACTIVE for port object 5e1dd2e6-fe77-43bc-98bf-f1a63705734c will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:16:07.091209 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-bb984cd7-e9b0-4eba-8cfe-0821360fb246 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:07.098252 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-bb984cd7-e9b0-4eba-8cfe-0821360fb246 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:07.098252 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-bb984cd7-e9b0-4eba-8cfe-0821360fb246 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/70afffe6-a390-4eba-82a2-cfd352c5c6ad HTTP/1.1" status: 204 len: 168 time: 0.4408927 Nov 24 11:16:07.109130 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb984cd7-e9b0-4eba-8cfe-0821360fb246 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70afffe6-a390-4eba-82a2-cfd352c5c6ad,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:07.203544 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:07.280916 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Pushing event updated for resources: {'Port': ['ID=5e1dd2e6-fe77-43bc-98bf-f1a63705734c,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:07.298578 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Attempting to bind port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:16:07.298578 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Attempting to bind port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:16:07.298578 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Attempting to bind port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c on network 8558262b-7125-4688-a6ea-2f1d2c3b2876 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:16:07.303721 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c on network 8558262b-7125-4688-a6ea-2f1d2c3b2876 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:16:07.304058 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Attempting to bind port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c on network 8558262b-7125-4688-a6ea-2f1d2c3b2876 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:16:07.309184 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 15, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:16:07.309518 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Checking segment: {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:16:07.309890 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Bound using segment: {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:16:07.310385 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Bound port: 5e1dd2e6-fe77-43bc-98bf-f1a63705734c, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:16:07.310739 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:07.373596 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] For port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:16:07.379357 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] For port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=5e1dd2e6-fe77-43bc-98bf-f1a63705734c,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:16:07.526955 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:07.571130 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:07.571777 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:07.573322 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] 10.222.0.86 "PUT /v2.0/ports/5e1dd2e6-fe77-43bc-98bf-f1a63705734c HTTP/1.1" status: 200 len: 1094 time: 1.1567054 Nov 24 11:16:07.576007 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1451c900-3066-4ab6-a01e-7abc8ed53cfc', 'tag': '5e1dd2e6-fe77-43bc-98bf-f1a63705734c'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:16:07.584593 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59bb345c-13f3-4f67-a851-0c5979c504dc" -d '{"events": [{"name": "network-changed", "server_uuid": "1451c900-3066-4ab6-a01e-7abc8ed53cfc", "tag": "5e1dd2e6-fe77-43bc-98bf-f1a63705734c"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:16:07.628956 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac023cf9-5334-4204-bb4c-5c44ac11a613 service neutron] Pushing event updated for resources: {'Port': ['ID=5e1dd2e6-fe77-43bc-98bf-f1a63705734c,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:07.634690 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:16:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00b73104-acaa-457e-9dab-b50b265dd76d x-openstack-request-id: req-00b73104-acaa-457e-9dab-b50b265dd76d {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:16:07.635028 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1451c900-3066-4ab6-a01e-7abc8ed53cfc", "tag": "5e1dd2e6-fe77-43bc-98bf-f1a63705734c", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:16:07.635313 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-00b73104-acaa-457e-9dab-b50b265dd76d {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:16:07.635705 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1451c900-3066-4ab6-a01e-7abc8ed53cfc', 'tag': '5e1dd2e6-fe77-43bc-98bf-f1a63705734c', 'status': 'completed', 'code': 200} Nov 24 11:16:07.749801 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59bb345c-13f3-4f67-a851-0c5979c504dc req-2e454b68-ef68-4d1a-a4b7-b0665e952853 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:07.751677 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-59bb345c-13f3-4f67-a851-0c5979c504dc req-2e454b68-ef68-4d1a-a4b7-b0665e952853 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 1097 time: 0.0704141 Nov 24 11:16:07.861068 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59bb345c-13f3-4f67-a851-0c5979c504dc req-3dbf4e79-32e8-4af8-bc6a-b18bd94b69e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:07.862832 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-59bb345c-13f3-4f67-a851-0c5979c504dc req-3dbf4e79-32e8-4af8-bc6a-b18bd94b69e2 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=fae8312f669b48b797904792401edfa4&shared=False HTTP/1.1" status: 200 len: 917 time: 0.0982072 Nov 24 11:16:07.883973 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-53ad79bf-43fe-42fe-a63b-536a63f3eaf4 req-0717e76d-9a70-4361-8852-5a5ea2ee42de tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 210 time: 0.0438399 Nov 24 11:16:07.954293 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bae7450-53a7-4b8d-b4eb-966a317d8ced req-17a974a9-7c53-48dd-8217-b2f2c5c7322f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:07.957357 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9bae7450-53a7-4b8d-b4eb-966a317d8ced req-17a974a9-7c53-48dd-8217-b2f2c5c7322f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 944 time: 0.0529706 Nov 24 11:16:07.977238 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59bb345c-13f3-4f67-a851-0c5979c504dc req-7e3540fd-f344-42e7-8eb3-59f440142387 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:07.978694 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-59bb345c-13f3-4f67-a851-0c5979c504dc req-7e3540fd-f344-42e7-8eb3-59f440142387 service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1070504 Nov 24 11:16:08.010078 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9bae7450-53a7-4b8d-b4eb-966a317d8ced req-63d46094-c04d-41d5-b347-ed54bebf203c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465767 Nov 24 11:16:08.061045 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-7401f6fc-e4a8-4145-8ad4-08b61472b8cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:08.062521 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-7401f6fc-e4a8-4145-8ad4-08b61472b8cb service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 1097 time: 0.0421705 Nov 24 11:16:08.110679 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ba5383a1-cbc8-436f-bd02-4e1c158ef551 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=5e1dd2e6-fe77-43bc-98bf-f1a63705734c HTTP/1.1" status: 200 len: 217 time: 0.0389616 Nov 24 11:16:08.173832 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-7fe18a27-5f20-446c-b6fa-f7440c5498b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:08.176119 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-7fe18a27-5f20-446c-b6fa-f7440c5498b3 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=cd868cb4-b7fb-4350-b027-a21baabac768 HTTP/1.1" status: 200 len: 855 time: 0.0452123 Nov 24 11:16:08.210917 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-ee1b6bd8-1b24-42ba-be47-2733c2f1d9ad service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=8558262b-7125-4688-a6ea-2f1d2c3b2876&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0239992 Nov 24 11:16:08.327847 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-f4181ec1-b042-44c8-b8e3-e1b50cfac34d service neutron] 10.222.0.86 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1014891 Nov 24 11:16:08.442878 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-027ea8c6-d872-41f7-919a-cbae8a1118ba req-5250440a-a07e-4c0b-b7ae-60b4617dded9 service neutron] 10.222.0.86 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0996881 Nov 24 11:16:08.442878 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54808) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:08.487128 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_v2 [None req-a6ec4c45-45df-44f4-aa43-06be0bdc6c58 admin admin] Deleting subnet 48d293f1-718f-4cda-9b6b-9bfc422e2fdd {{(pid=103243) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:16:08.490355 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a6ec4c45-45df-44f4-aa43-06be0bdc6c58 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:08.529203 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a6ec4c45-45df-44f4-aa43-06be0bdc6c58 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:08.539827 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a6ec4c45-45df-44f4-aa43-06be0bdc6c58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:08.638338 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a6ec4c45-45df-44f4-aa43-06be0bdc6c58 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for subnet, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:08.667623 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6ec4c45-45df-44f4-aa43-06be0bdc6c58 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=48d293f1-718f-4cda-9b6b-9bfc422e2fdd,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:08.676355 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a6ec4c45-45df-44f4-aa43-06be0bdc6c58 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:08.680528 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-a6ec4c45-45df-44f4-aa43-06be0bdc6c58 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/48d293f1-718f-4cda-9b6b-9bfc422e2fdd HTTP/1.1" status: 204 len: 168 time: 0.2369220 Nov 24 11:16:08.683243 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54818) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:08.700849 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-cd0e9308-8f3b-4959-89a6-e65121daf900 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:08.763600 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:08.848992 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:08.870635 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:08.871004 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:08.871841 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:08.872110 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > port after_create 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:08.872439 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > port after_delete 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:08.873061 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > port after_update 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:08.873378 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:08.873704 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:08.874010 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:08.874320 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:09.008955 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54830) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:09.035849 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:09.037120 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:09.037369 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:09.037934 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=103244) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:16:09.038479 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['86e5ef24-6f2b-4928-b692-ecb9fd8c0b23']}} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:16:09.068390 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6c194338-e70c-49da-8985-8d59db407c63') {'for_net_delete': True} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:16:09.069070 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6c194338-e70c-49da-8985-8d59db407c63') {} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:16:09.094451 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7f2f2c07-beea-4670-89f4-9029154f4be1 req-35440209-da89-41e0-bcea-0c6a9229b28f tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 210 time: 0.0498767 Nov 24 11:16:09.107369 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.110641 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4161272'] for segment, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.166456 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.168201 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0e46d863-5933-434e-88ca-f14d60df3326 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.178846 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Releasing vlan 1209 on physical network physnet1 to pool {{(pid=103244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:16:09.179242 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8699699'] for segment, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: from cryptography.utils import int_from_bytes Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: from cryptography.utils import int_from_bytes Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: Traceback (most recent call last): Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: timer() Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: cb(*args, **kw) Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: return func(*args, **kwargs) Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: self._notify() Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: self.callback(batched_events) Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: event.method(event) Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: return f(self, *a, **k) Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._get(url).json() Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: return self.request(url, 'GET', **kwargs) Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:16:09.208925 dv-cinder-804035-18-iscsi neutron-server[103244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:16:09.230090 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2742818d-653b-4a9c-8dd0-be35f8bc01d1 req-ff386428-7d28-437d-9723-e04d18398a0c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:09.231658 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2742818d-653b-4a9c-8dd0-be35f8bc01d1 req-ff386428-7d28-437d-9723-e04d18398a0c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 944 time: 0.1360190 Nov 24 11:16:09.264084 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-7be0776f-e2cf-435d-93f4-32eb34ebb2cb tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.86 "GET /v2.0/networks?tenant_id=b898b9cc37224c3ab1f1d21b45ad66eb&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0353253 Nov 24 11:16:09.313663 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2742818d-653b-4a9c-8dd0-be35f8bc01d1 req-640bb7a0-1050-4599-8fb4-e1c8a32b56a4 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0729146 Nov 24 11:16:09.329386 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0e46d863-5933-434e-88ca-f14d60df3326 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.351685 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.358763 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.368091 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] 10.222.0.76 "DELETE /v2.0/networks/86e5ef24-6f2b-4928-b692-ecb9fd8c0b23 HTTP/1.1" status: 204 len: 168 time: 0.6812491 Nov 24 11:16:09.387597 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35b53bf0-7b22-4aee-87e1-ae5f1dd19725 admin admin] Pushing event deleted for resources: {'Network': ['ID=86e5ef24-6f2b-4928-b692-ecb9fd8c0b23,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:09.426424 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0e46d863-5933-434e-88ca-f14d60df3326 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.499706 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e46d863-5933-434e-88ca-f14d60df3326 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bec15cf-2851-4c91-8025-d511e3ca9c4d,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:09.507120 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-0e46d863-5933-434e-88ca-f14d60df3326 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=eac7fa4908184054bcc2dc0fde092968&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4942975 Nov 24 11:16:09.507737 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54840) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:09.512650 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-466ed9c0-1338-499c-b764-11ee11f3fc06 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:09.514047 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-466ed9c0-1338-499c-b764-11ee11f3fc06 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2392926 Nov 24 11:16:09.529102 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Request body: {'port': {'device_id': 'a7c8efee-bf60-46b8-84d0-45c8b0acae17', 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c', 'admin_state_up': True, 'tenant_id': 'b898b9cc37224c3ab1f1d21b45ad66eb'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:09.562584 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-24209935-dd45-4e41-a8a5-328191bc8248 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.584680 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-24209935-dd45-4e41-a8a5-328191bc8248 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.705944 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-24209935-dd45-4e41-a8a5-328191bc8248 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.708613 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-24209935-dd45-4e41-a8a5-328191bc8248 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.712288 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-24209935-dd45-4e41-a8a5-328191bc8248 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/4bec15cf-2851-4c91-8025-d511e3ca9c4d HTTP/1.1" status: 204 len: 168 time: 0.2011137 Nov 24 11:16:09.717379 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24209935-dd45-4e41-a8a5-328191bc8248 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bec15cf-2851-4c91-8025-d511e3ca9c4d,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:09.723190 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Made reservation on behalf of b898b9cc37224c3ab1f1d21b45ad66eb for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:16:09.727935 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.738587 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.755527 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54854) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:09.825356 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-b5af9e57-652e-4b44-83d4-d636606b6c5d admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=1b97c43049d94ba3b99a111a9b91864d&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0684478 Nov 24 11:16:09.831875 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54858) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:09.849442 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.886562 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e858881f-8096-47d1-94de-7815d43e2d7c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.908954 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e858881f-8096-47d1-94de-7815d43e2d7c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:09.917555 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:10.010274 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Pushing event updated for resources: {'SecurityGroup': ['ID=480ab1d3-b975-419a-89c0-5a2ddd41c025,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:10.071330 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54864) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:10.091852 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Allocated IP 192.168.233.212 (4c664793-4f02-4ee0-8065-d295f3934f2c/788d9121-5618-4111-9367-9c60f72fb59c/bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:16:10.139202 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e858881f-8096-47d1-94de-7815d43e2d7c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:10.141796 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e858881f-8096-47d1-94de-7815d43e2d7c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:10.143588 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-e858881f-8096-47d1-94de-7815d43e2d7c admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/b89c6fa0-e54d-48e4-be18-454c74244462 HTTP/1.1" status: 204 len: 168 time: 0.3092723 Nov 24 11:16:10.156435 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e858881f-8096-47d1-94de-7815d43e2d7c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b89c6fa0-e54d-48e4-be18-454c74244462,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:10.220497 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a9b96489-8dee-46de-a9f1-acdfc7e13495 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:10.268984 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0954f822-8f38-4fda-a9ae-272c5355a66f req-2934d9ea-e816-414a-81a6-543eed214692 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 210 time: 0.0684528 Nov 24 11:16:10.316222 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:10.345255 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a9b96489-8dee-46de-a9f1-acdfc7e13495 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:10.411274 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:10.445481 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a9b96489-8dee-46de-a9f1-acdfc7e13495 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:10.466483 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Network 4c664793-4f02-4ee0-8065-d295f3934f2c is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:16:10.475785 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:16:10.479705 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:16:10.485230 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:10.485852 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:10.499485 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Pushing event updated for resources: {'Port': ['ID=bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:10.515844 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-a9b96489-8dee-46de-a9f1-acdfc7e13495 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=41b3f97059424cc984df2719bfa86457&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4433699 Nov 24 11:16:10.516147 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54890) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:10.527763 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fafc3eca-92ac-48b2-acf4-8ab1e55fd30f req-174230ae-8e65-4893-8db0-896d3a4bacf9 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:10.535813 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fafc3eca-92ac-48b2-acf4-8ab1e55fd30f req-174230ae-8e65-4893-8db0-896d3a4bacf9 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 944 time: 0.1453989 Nov 24 11:16:10.537940 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9b96489-8dee-46de-a9f1-acdfc7e13495 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1670b48b-b2ce-4d25-9955-3ab8b163176e,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:10.587388 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-3e73be9b-3b5e-4835-b082-3b990755f12b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.0618327 Nov 24 11:16:10.609606 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Request body: {'port': {'device_id': 'a7c8efee-bf60-46b8-84d0-45c8b0acae17', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:10.634943 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fafc3eca-92ac-48b2-acf4-8ab1e55fd30f req-06ae2df1-a11f-476c-8443-7b3e0956f316 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0815406 Nov 24 11:16:10.814450 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-a0107907-b6b3-48ca-aa26-834ebc97bb1c None None] Provisioning complete for port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:16:10.816132 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-a0107907-b6b3-48ca-aa26-834ebc97bb1c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:10.859349 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-a0107907-b6b3-48ca-aa26-834ebc97bb1c None None] Port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:16:10.888678 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7762df76-e0e6-4d02-9d7c-c1b048cc208d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:10.930947 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:10.953758 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7762df76-e0e6-4d02-9d7c-c1b048cc208d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:11.163195 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7762df76-e0e6-4d02-9d7c-c1b048cc208d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:11.166872 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7762df76-e0e6-4d02-9d7c-c1b048cc208d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:11.166975 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-7762df76-e0e6-4d02-9d7c-c1b048cc208d admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/1670b48b-b2ce-4d25-9955-3ab8b163176e HTTP/1.1" status: 204 len: 168 time: 0.6499631 Nov 24 11:16:11.187465 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7762df76-e0e6-4d02-9d7c-c1b048cc208d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1670b48b-b2ce-4d25-9955-3ab8b163176e,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:11.187698 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0c994cdd-1e70-4ab6-88d6-f956061cd6d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:11.264697 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:16:11.272399 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:11.285018 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Transition to ACTIVE for port object bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:16:11.318550 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54928) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:11.368933 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:11.424192 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6f6133c-b5fc-48cc-9d0c-62780054f5b5 req-7e00fa60-a4c4-4994-a7d4-95bb62bf1c02 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:11.426343 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Pushing event updated for resources: {'Port': ['ID=bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:11.438555 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e6f6133c-b5fc-48cc-9d0c-62780054f5b5 req-7e00fa60-a4c4-4994-a7d4-95bb62bf1c02 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 936 time: 0.0849741 Nov 24 11:16:11.456004 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Attempting to bind port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:16:11.456338 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Attempting to bind port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': 'cd60819a-febf-4221-b2e4-966d325c3c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1214, 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:16:11.456846 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Attempting to bind port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce on network 4c664793-4f02-4ee0-8065-d295f3934f2c {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:16:11.461829 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce on network 4c664793-4f02-4ee0-8065-d295f3934f2c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:16:11.462938 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Attempting to bind port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce on network 4c664793-4f02-4ee0-8065-d295f3934f2c {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:16:11.469274 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 16, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:16:11.469602 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Checking segment: {'id': 'cd60819a-febf-4221-b2e4-966d325c3c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1214, 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:16:11.472192 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Bound using segment: {'id': 'cd60819a-febf-4221-b2e4-966d325c3c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1214, 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:16:11.476704 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Bound port: bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cd60819a-febf-4221-b2e4-966d325c3c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1214, 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:16:11.477119 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:11.539199 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e6f6133c-b5fc-48cc-9d0c-62780054f5b5 req-03deedb4-1895-46f1-ac01-af7e07f6f5a3 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1042738 Nov 24 11:16:11.608121 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] For port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:16:11.612889 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] For port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce,segment=NetworkSegment(cd60819a-febf-4221-b2e4-966d325c3c03),segment_id=cd60819a-febf-4221-b2e4-966d325c3c03)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:16:11.649848 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1610280202-network', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:11.718040 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:11.751469 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1d1b40a-fb2e-464b-892e-afc328893b5b req-f8a2620e-fcbe-4e1f-82ea-b8194527a4af tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:11.753000 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b1d1b40a-fb2e-464b-892e-afc328893b5b req-f8a2620e-fcbe-4e1f-82ea-b8194527a4af tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 944 time: 0.0520527 Nov 24 11:16:11.761305 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Made reservation on behalf of 30efcb46099b42a3a76be0d52d0d0213 for: {'network': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:16:11.761305 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:11.765057 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:11.765672 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:11.767064 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] 10.222.0.86 "PUT /v2.0/ports/bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce HTTP/1.1" status: 200 len: 1098 time: 1.1697376 Nov 24 11:16:11.775971 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a7c8efee-bf60-46b8-84d0-45c8b0acae17', 'tag': 'bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:16:11.778642 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-99a064b7-2291-41da-a6a7-e3d7fa049669" -d '{"events": [{"name": "network-changed", "server_uuid": "a7c8efee-bf60-46b8-84d0-45c8b0acae17", "tag": "bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:16:11.788262 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:11.819354 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b1d1b40a-fb2e-464b-892e-afc328893b5b req-5d79c817-dd3d-4837-ac43-358c76e23a51 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0598717 Nov 24 11:16:11.821200 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d5e4eff-ccce-4543-af82-682e285ec013 service neutron] Pushing event updated for resources: {'Port': ['ID=bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:11.832958 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:16:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0794811-a5e3-4c8d-9491-3d508026188f x-openstack-request-id: req-a0794811-a5e3-4c8d-9491-3d508026188f {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:16:11.833262 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a7c8efee-bf60-46b8-84d0-45c8b0acae17", "tag": "bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:16:11.833512 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-a0794811-a5e3-4c8d-9491-3d508026188f {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:16:11.834066 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a7c8efee-bf60-46b8-84d0-45c8b0acae17', 'tag': 'bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce', 'status': 'completed', 'code': 200} Nov 24 11:16:11.954035 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a064b7-2291-41da-a6a7-e3d7fa049669 req-c6c5a873-af44-46df-8222-d6ad8b366951 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:11.956524 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-99a064b7-2291-41da-a6a7-e3d7fa049669 req-c6c5a873-af44-46df-8222-d6ad8b366951 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=b898b9cc37224c3ab1f1d21b45ad66eb&device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 1101 time: 0.0960202 Nov 24 11:16:11.989915 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.021885 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-99a064b7-2291-41da-a6a7-e3d7fa049669 req-b0fd8ef3-06c6-4cde-acde-961aaf1bddf4 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=b898b9cc37224c3ab1f1d21b45ad66eb&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0304916 Nov 24 11:16:12.040779 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54948) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:12.055181 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d45863b7-266a-4913-9171-7521c0c87b80 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.061735 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:16:12.134307 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.144279 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d45863b7-266a-4913-9171-7521c0c87b80 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.181079 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1226} {{(pid=103243) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:16:12.187415 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1c244bc-af79-4d84-9201-e93ea1d6e9d3,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:12.206772 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.207115 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.segments_db [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Added segment a796222b-4203-47ee-8ece-5d33e9d64672 of type vlan for network b21f02d2-c533-4fb1-acd2-d2fd73a5180a Nov 24 11:16:12.216882 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a064b7-2291-41da-a6a7-e3d7fa049669 req-890007b8-30c9-44dd-b662-b0fb69f7cb12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:12.218347 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-99a064b7-2291-41da-a6a7-e3d7fa049669 req-890007b8-30c9-44dd-b662-b0fb69f7cb12 service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1837261 Nov 24 11:16:12.250173 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.265828 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d45863b7-266a-4913-9171-7521c0c87b80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.309681 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-d45863b7-266a-4913-9171-7521c0c87b80 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=7215c04a378b44c4828b2105d73b6cc8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2678964 Nov 24 11:16:12.312595 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d45863b7-266a-4913-9171-7521c0c87b80 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=54ba50c6-cb76-4520-a1bf-e7d1a111461d,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:12.314489 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-ec9bac92-e39a-45b7-a9a0-f898f478d3c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:12.315329 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 54958) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:12.316224 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-ec9bac92-e39a-45b7-a9a0-f898f478d3c5 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=b898b9cc37224c3ab1f1d21b45ad66eb&device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 1101 time: 0.0500424 Nov 24 11:16:12.365780 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.366730 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:12.367327 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.371826 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9960370c-301d-4139-9de7-a3786ceb3b26 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.372495 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-ad7be4b4-3996-4116-82cf-4a836d9bba27 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.212&port_id=bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce HTTP/1.1" status: 200 len: 217 time: 0.0444760 Nov 24 11:16:12.394209 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9960370c-301d-4139-9de7-a3786ceb3b26 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.438661 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 5e1dd2e6-fe77-43bc-98bf-f1a63705734c details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:16:12.444589 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.464297 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] Pushing event updated for resources: {'Network': ['ID=b21f02d2-c533-4fb1-acd2-d2fd73a5180a,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:12.473755 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-d84ea834-3a96-4947-94eb-658d25302c14 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 1.1508644 Nov 24 11:16:12.473755 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54962) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:12.479107 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-8102cd2a-4342-471b-8208-8fefd583541f admin admin] Request body: {'subnet': {'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1610280202-subnet', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:12.488418 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-ff938740-a36a-4961-b0f3-6dfa1d2ce2ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:12.489530 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network b21f02d2-c533-4fb1-acd2-d2fd73a5180a details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:16:12.489918 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-ff938740-a36a-4961-b0f3-6dfa1d2ce2ca service neutron] 10.222.0.86 "GET /v2.0/subnets?id=788d9121-5618-4111-9367-9c60f72fb59c HTTP/1.1" status: 200 len: 843 time: 0.1022346 Nov 24 11:16:12.500208 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9960370c-301d-4139-9de7-a3786ceb3b26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.505109 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9960370c-301d-4139-9de7-a3786ceb3b26 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.506355 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-9960370c-301d-4139-9de7-a3786ceb3b26 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/54ba50c6-cb76-4520-a1bf-e7d1a111461d HTTP/1.1" status: 204 len: 168 time: 0.1900156 Nov 24 11:16:12.518931 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9960370c-301d-4139-9de7-a3786ceb3b26 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=54ba50c6-cb76-4520-a1bf-e7d1a111461d,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:12.563035 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-80b28d32-7bac-49e5-92ec-288478915a32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:12.565984 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-80b28d32-7bac-49e5-92ec-288478915a32 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=4c664793-4f02-4ee0-8065-d295f3934f2c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1179 time: 0.0647650 Nov 24 11:16:12.613237 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8102cd2a-4342-471b-8208-8fefd583541f admin admin] Made reservation on behalf of 30efcb46099b42a3a76be0d52d0d0213 for: {'subnet': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:16:12.627971 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8102cd2a-4342-471b-8208-8fefd583541f admin admin] Publish callbacks [] for subnet, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.628136 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=5e1dd2e6-fe77-43bc-98bf-f1a63705734c,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:12.640434 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '5e1dd2e6-fe77-43bc-98bf-f1a63705734c', 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876', 'port_id': '5e1dd2e6-fe77-43bc-98bf-f1a63705734c', 'mac_address': 'fa:16:3e:b8:98:87', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1227, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cd868cb4-b7fb-4350-b027-a21baabac768', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:16:12.670154 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-028426ae-c583-428a-9cc9-7f727594b5e6 req-fedd0dfc-c588-4a46-9e96-ea7877d71d12 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:12.671657 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-028426ae-c583-428a-9cc9-7f727594b5e6 req-fedd0dfc-c588-4a46-9e96-ea7877d71d12 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 948 time: 0.0690808 Nov 24 11:16:12.690395 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.705116 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5e1dd2e6-fe77-43bc-98bf-f1a63705734c {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:16:12.725516 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-028426ae-c583-428a-9cc9-7f727594b5e6 req-a63c3abf-bd24-4e4e-b857-87af7ddb5dac tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443039 Nov 24 11:16:12.730304 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=5e1dd2e6-fe77-43bc-98bf-f1a63705734c,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:12.760000 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-90219461-a746-440e-a360-e830f1fc14a7 service neutron] 10.222.0.86 "GET /v2.0/networks/4c664793-4f02-4ee0-8065-d295f3934f2c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1867311 Nov 24 11:16:12.797312 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:12.850410 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=5e1dd2e6-fe77-43bc-98bf-f1a63705734c,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:12.858426 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:12.858801 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:12.859155 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:12.859529 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:12.859860 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:12.860201 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:12.861055 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:12.861055 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:12.862235 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:12.862235 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:12.862434 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:12.862659 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:12.932285 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d68edafb-6db2-4a08-b5d9-622c0aeda774 req-b770802d-b937-4570-a97c-b01e47f2b58d service neutron] 10.222.0.86 "GET /v2.0/networks/4c664793-4f02-4ee0-8065-d295f3934f2c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1592977 Nov 24 11:16:12.980593 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6971ef8a-f9a5-4bee-b3e8-9deb324dfe05 req-f8acafcb-251a-4575-899e-d1449c5b09a0 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:12.982091 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6971ef8a-f9a5-4bee-b3e8-9deb324dfe05 req-f8acafcb-251a-4575-899e-d1449c5b09a0 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 945 time: 0.0547340 Nov 24 11:16:13.028586 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8102cd2a-4342-471b-8208-8fefd583541f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for subnet, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:13.042865 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6971ef8a-f9a5-4bee-b3e8-9deb324dfe05 req-572e127b-69c6-4b06-a06a-9da2c023b14d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489902 Nov 24 11:16:13.075651 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['5e1dd2e6-fe77-43bc-98bf-f1a63705734c'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:16:13.083168 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8102cd2a-4342-471b-8208-8fefd583541f admin admin] Pushing event updated for resources: {'Subnet': ['ID=e89fe7df-9fbd-43c3-9f7a-0597324b938f,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:13.112278 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8102cd2a-4342-471b-8208-8fefd583541f admin admin] Checking segment: {'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:16:13.112278 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8102cd2a-4342-471b-8208-8fefd583541f admin admin] Network hostable DHCP agents. Network: b21f02d2-c533-4fb1-acd2-d2fd73a5180a, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103243) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:16:13.243252 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8102cd2a-4342-471b-8208-8fefd583541f admin admin] Network b21f02d2-c533-4fb1-acd2-d2fd73a5180a is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103243) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:16:13.323120 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-8102cd2a-4342-471b-8208-8fefd583541f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, b21f02d2-c533-4fb1-acd2-d2fd73a5180a) {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:16:13.327774 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8102cd2a-4342-471b-8208-8fefd583541f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:13.328369 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8102cd2a-4342-471b-8208-8fefd583541f admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:13.340345 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ecbea1f-1f11-4bc4-a410-10aea060fb5b None None] Network b21f02d2-c533-4fb1-acd2-d2fd73a5180a requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:16:13.446098 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-8102cd2a-4342-471b-8208-8fefd583541f admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.9714007 Nov 24 11:16:13.448915 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 54996) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:13.454284 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1610280202-router', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:13.481410 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d1bae27-c833-49bf-9f48-078f0e5c08bc None None] Network b21f02d2-c533-4fb1-acd2-d2fd73a5180a requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:16:13.586483 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1010094', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:13.587971 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1009794', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-534758', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-985777', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-654'] for router, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:13.658897 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:13.870280 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd7ff558-8c3f-4be9-a309-45a37b315680 req-20402626-3593-4b69-b7aa-f9f5ceeabf8b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:13.872960 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fd7ff558-8c3f-4be9-a309-45a37b315680 req-20402626-3593-4b69-b7aa-f9f5ceeabf8b tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 948 time: 0.0719969 Nov 24 11:16:13.897076 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:13.925683 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fd7ff558-8c3f-4be9-a309-45a37b315680 req-106b6bb0-b19d-47df-badb-e0f288dffd02 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453398 Nov 24 11:16:14.054513 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:14.204538 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4afeb4c9-19cd-4a24-acbd-a6c272501e6f req-63fee617-1d8e-4cb0-a282-e3ca11ea6af3 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:14.206891 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4afeb4c9-19cd-4a24-acbd-a6c272501e6f req-63fee617-1d8e-4cb0-a282-e3ca11ea6af3 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 945 time: 0.0642345 Nov 24 11:16:14.262153 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4afeb4c9-19cd-4a24-acbd-a6c272501e6f req-fd1a3ba1-4db5-4eaf-b1e2-de51b00569a7 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474145 Nov 24 11:16:14.270719 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:14.291119 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:14.416689 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Allocated IP 172.27.3.157 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/15b4d7f1-cd06-48e1-b481-3633461f0922) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:16:14.467095 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 5e1dd2e6-fe77-43bc-98bf-f1a63705734c up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:16:14.526709 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:14.608563 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:16:14.613243 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:16:14.613674 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:14.661043 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:14.692816 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:14.701581 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:16:14.704465 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:16:14.711195 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:16:14.723896 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1451c900-3066-4ab6-a01e-7abc8ed53cfc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5e1dd2e6-fe77-43bc-98bf-f1a63705734c'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:16:14.726614 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be565448-99fd-4c2d-8d68-d43a1d6b4136" -d '{"events": [{"server_uuid": "1451c900-3066-4ab6-a01e-7abc8ed53cfc", "name": "network-vif-plugged", "status": "completed", "tag": "5e1dd2e6-fe77-43bc-98bf-f1a63705734c"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:16:14.749433 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=5e1dd2e6-fe77-43bc-98bf-f1a63705734c,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:14.773043 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:16:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a40e54d1-58fc-41a3-9e11-073c523063bd x-openstack-request-id: req-a40e54d1-58fc-41a3-9e11-073c523063bd {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:16:14.773658 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1451c900-3066-4ab6-a01e-7abc8ed53cfc", "name": "network-vif-plugged", "status": "completed", "tag": "5e1dd2e6-fe77-43bc-98bf-f1a63705734c", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:16:14.774113 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-a40e54d1-58fc-41a3-9e11-073c523063bd {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:16:14.774780 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1451c900-3066-4ab6-a01e-7abc8ed53cfc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5e1dd2e6-fe77-43bc-98bf-f1a63705734c', 'code': 200} Nov 24 11:16:14.786261 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Pushing event updated for resources: {'Port': ['ID=15b4d7f1-cd06-48e1-b481-3633461f0922,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:14.872135 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:14.880611 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:14.926701 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=5e1dd2e6-fe77-43bc-98bf-f1a63705734c,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:15.036993 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:15.073493 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d506dd4c-d9a2-4f82-8603-0efce934c8c4 req-c8e14d6e-0fb1-45a3-9bc0-8d593e12938c tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:15.081647 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d506dd4c-d9a2-4f82-8603-0efce934c8c4 req-c8e14d6e-0fb1-45a3-9bc0-8d593e12938c tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 948 time: 0.0699725 Nov 24 11:16:15.128560 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d506dd4c-d9a2-4f82-8603-0efce934c8c4 req-87ea1fa3-ad20-4fff-81e1-4b2683c9cd44 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452073 Nov 24 11:16:15.236880 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1009813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-942685'] for router, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:15.395469 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe284e08-cc54-4fbf-a5d3-62d19f407d2c req-a0d109af-48de-40ce-80f9-8250531bc4f9 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:15.397365 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fe284e08-cc54-4fbf-a5d3-62d19f407d2c req-a0d109af-48de-40ce-80f9-8250531bc4f9 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 946 time: 0.0576477 Nov 24 11:16:15.450587 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fe284e08-cc54-4fbf-a5d3-62d19f407d2c req-39cc1305-e3a8-4874-9474-551f79a579b8 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464234 Nov 24 11:16:15.716752 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Router 3521649d-4274-4082-9043-224fe9728321 is scheduled to L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 with binding_index 1 {{(pid=103243) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 11:16:15.823450 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:16:15.834149 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Sync routers for ids ['3521649d-4274-4082-9043-224fe9728321'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:16:15.843974 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Routers {'3521649d-4274-4082-9043-224fe9728321'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:16:15.844588 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:16:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['3521649d-4274-4082-9043-224fe9728321'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:16:15.890436 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] Publish callbacks [] for router, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:15.891710 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-e90ee775-f5c1-4056-a6f0-5e223ca2d66b admin admin] 10.222.0.76 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 2.4418015 Nov 24 11:16:15.894852 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 55076) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:15.952507 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Set router 3521649d-4274-4082-9043-224fe9728321 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:16:16.150653 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3521649d-4274-4082-9043-224fe9728321', 'name': 'tempest-ServerRescueNegativeTestJSON-1610280202-router', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157'}], 'enable_snat': True}, 'gw_port_id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:16:13Z', 'updated_at': '2021-11-24T11:16:14Z', 'revision_number': 3, 'project_id': '30efcb46099b42a3a76be0d52d0d0213', 'gw_port': {'id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:d0:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3521649d-4274-4082-9043-224fe9728321', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:16:14Z', 'updated_at': '2021-11-24T11:16:14Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:16:16.179104 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Checking router: 3521649d-4274-4082-9043-224fe9728321 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:16:16.179481 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Updating router 3521649d-4274-4082-9043-224fe9728321 port 15b4d7f1-cd06-48e1-b481-3633461f0922 binding host dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:16:16.203394 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:16.325466 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:16.491799 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Publish callbacks [] for port, precommit_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:16.591250 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:16.627575 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Allocated IP 172.20.0.1 (b21f02d2-c533-4fb1-acd2-d2fd73a5180a/e89fe7df-9fbd-43c3-9f7a-0597324b938f/3bd5a5b3-3819-40e6-8486-0b27d5b77365) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:16:16.643823 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Pushing event updated for resources: {'Port': ['ID=15b4d7f1-cd06-48e1-b481-3633461f0922,revision_number=2']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:16.645840 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Attempting to bind port 15b4d7f1-cd06-48e1-b481-3633461f0922 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:16:16.646210 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Attempting to bind port 15b4d7f1-cd06-48e1-b481-3633461f0922 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:16:16.646571 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Attempting to bind port 15b4d7f1-cd06-48e1-b481-3633461f0922 on network fa6231d1-a629-42bc-a091-20035dee3542 {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:16:16.655303 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:16.658179 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:16.658179 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:16.658179 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:16.658179 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:16.658179 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:16.658179 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:16.658179 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:16.658179 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:16.658691 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:16.659014 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:16.659367 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:16.662474 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 16, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:16:16.662852 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Checking segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:16:16.663250 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:16.663658 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Bound using segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:16:16.664128 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Bound port: 15b4d7f1-cd06-48e1-b481-3633461f0922, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:16:16.664548 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:16.716721 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] For port 15b4d7f1-cd06-48e1-b481-3633461f0922, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:16:16.719667 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] For port 15b4d7f1-cd06-48e1-b481-3633461f0922, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=15b4d7f1-cd06-48e1-b481-3633461f0922,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:16:16.733244 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:16.786753 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:16.838031 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:16.850652 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f425adc4-4544-4bc6-ae2d-311e8cd54e58 None None] Pushing event updated for resources: {'Port': ['ID=15b4d7f1-cd06-48e1-b481-3633461f0922,revision_number=3']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:16.853272 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Routers {'3521649d-4274-4082-9043-224fe9728321'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:16:16.853870 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:16:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['3521649d-4274-4082-9043-224fe9728321'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:16:16.883912 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Network b21f02d2-c533-4fb1-acd2-d2fd73a5180a is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:16:16.886715 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:16:16.889151 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:16:16.889804 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1009482'] for router_interface, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:16.928214 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Pushing event updated for resources: {'Port': ['ID=3bd5a5b3-3819-40e6-8486-0b27d5b77365,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:16.962706 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] Set router 3521649d-4274-4082-9043-224fe9728321 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:16:17.098720 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:17.233269 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3521649d-4274-4082-9043-224fe9728321', 'name': 'tempest-ServerRescueNegativeTestJSON-1610280202-router', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157'}], 'enable_snat': True}, 'gw_port_id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:16:13Z', 'updated_at': '2021-11-24T11:16:14Z', 'revision_number': 3, 'project_id': '30efcb46099b42a3a76be0d52d0d0213', 'gw_port': {'id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:d0:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3521649d-4274-4082-9043-224fe9728321', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:16:14Z', 'updated_at': '2021-11-24T11:16:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:16:17.259448 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f39bbba-6f51-48f4-85e7-c3289b29810b None None] The sync data for ids ['3521649d-4274-4082-9043-224fe9728321'] in dv-cinder-804035-18-iscsi is: [{'id': '3521649d-4274-4082-9043-224fe9728321', 'name': 'tempest-ServerRescueNegativeTestJSON-1610280202-router', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157'}], 'enable_snat': True}, 'gw_port_id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:16:13Z', 'updated_at': '2021-11-24T11:16:14Z', 'revision_number': 3, 'project_id': '30efcb46099b42a3a76be0d52d0d0213', 'gw_port': {'id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:d0:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3521649d-4274-4082-9043-224fe9728321', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:16:14Z', 'updated_at': '2021-11-24T11:16:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:16:17.286433 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:17.309548 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:16:17.414459 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce,segment=NetworkSegment(cd60819a-febf-4221-b2e4-966d325c3c03),segment_id=cd60819a-febf-4221-b2e4-966d325c3c03)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:17.415549 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:17.416705 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-636370', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1009638'] for router_interface, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:17.426675 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': 'bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce', 'network_id': '4c664793-4f02-4ee0-8065-d295f3934f2c', 'port_id': 'bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce', 'mac_address': 'fa:16:3e:a6:97:2b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1214, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '788d9121-5618-4111-9367-9c60f72fb59c', 'ip_address': '192.168.233.212'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:16:17.517328 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:17.528542 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Pushing event updated for resources: {'Port': ['ID=3bd5a5b3-3819-40e6-8486-0b27d5b77365,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:17.556258 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:16:17.580998 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b3d5d64-65bc-4441-8af7-90010923f730 req-5d6ad264-ff43-4e45-93ec-a23144b69604 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:17.586640 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce,segment=NetworkSegment(cd60819a-febf-4221-b2e4-966d325c3c03),segment_id=cd60819a-febf-4221-b2e4-966d325c3c03)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:17.588362 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2b3d5d64-65bc-4441-8af7-90010923f730 req-5d6ad264-ff43-4e45-93ec-a23144b69604 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 948 time: 0.1421337 Nov 24 11:16:17.608724 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Network b21f02d2-c533-4fb1-acd2-d2fd73a5180a is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:16:17.610532 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:16:17.624907 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c30ee34-cb1d-4c68-ad94-074e815ff15c req-99f8fdc3-889f-4b84-8cc7-076b1d2a06b0 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:17.626411 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0c30ee34-cb1d-4c68-ad94-074e815ff15c req-99f8fdc3-889f-4b84-8cc7-076b1d2a06b0 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 946 time: 0.1375661 Nov 24 11:16:17.695860 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2b3d5d64-65bc-4441-8af7-90010923f730 req-b9a18780-974a-42da-b768-e14557d55a07 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1064186 Nov 24 11:16:17.705895 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:17.741584 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0c30ee34-cb1d-4c68-ad94-074e815ff15c req-28f1dd80-83f3-4ff1-9958-7c0b92788ebc tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1027415 Nov 24 11:16:17.791006 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:17.836083 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Router 3521649d-4274-4082-9043-224fe9728321 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:16:17.838720 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8919f67-8181-4de9-a170-e687fb38280f req-7532bddd-b3d0-4b94-9681-fd3761c75a36 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:17.840239 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e8919f67-8181-4de9-a170-e687fb38280f req-7532bddd-b3d0-4b94-9681-fd3761c75a36 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 1099 time: 0.0898924 Nov 24 11:16:17.972044 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e8919f67-8181-4de9-a170-e687fb38280f req-83792e5c-cb9e-462e-8dbe-52c25a59f7ef service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1222205 Nov 24 11:16:17.995198 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:16:17.998425 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:16:18.006043 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-fddf7bf4-c248-4876-bd2a-57e76a043f08 admin admin] 10.222.0.76 "PUT /v2.0/routers/3521649d-4274-4082-9043-224fe9728321/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1101153 Nov 24 11:16:18.738065 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-7a948a8a-860a-4578-a81c-15b248ee0743 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:18.739593 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-7a948a8a-860a-4578-a81c-15b248ee0743 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/networks?id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a HTTP/1.1" status: 200 len: 819 time: 0.3502069 Nov 24 11:16:18.755885 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-9501cd7a-534d-4db2-ad55-b40914f10fd6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/quotas/30efcb46099b42a3a76be0d52d0d0213 HTTP/1.1" status: 200 len: 375 time: 0.0100727 Nov 24 11:16:18.836038 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-3e2eb047-de90-4d1e-a04e-999043e44825 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=30efcb46099b42a3a76be0d52d0d0213&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0743358 Nov 24 11:16:18.859480 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76207949-175f-4907-a2d5-24b6fd70076e req-5ea74117-2706-4d0e-b447-c8681f15e9f4 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:18.861376 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-76207949-175f-4907-a2d5-24b6fd70076e req-5ea74117-2706-4d0e-b447-c8681f15e9f4 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 949 time: 0.0735126 Nov 24 11:16:18.975583 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-76207949-175f-4907-a2d5-24b6fd70076e req-402343c2-cdf9-47c2-b38d-978a590adebc tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0996847 Nov 24 11:16:19.031253 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 15b4d7f1-cd06-48e1-b481-3633461f0922 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:16:19.038320 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-694b6ac0-29d3-4750-9c4c-ea8aebc80d04 service neutron] 10.222.0.76 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1949027 Nov 24 11:16:19.121675 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 15b4d7f1-cd06-48e1-b481-3633461f0922 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:16:19.123608 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:19.192412 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-808d3a14-718b-4d5c-b125-8425c3c4b8cc req-7e10e322-883e-4695-b712-ca09684de60d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:19.193823 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-808d3a14-718b-4d5c-b125-8425c3c4b8cc req-7e10e322-883e-4695-b712-ca09684de60d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 946 time: 0.1278834 Nov 24 11:16:19.217924 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:19.240490 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-0f500917-9f86-46e7-afcc-e105a82999a1 service neutron] 10.222.0.76 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2009215 Nov 24 11:16:19.241019 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] For port 15b4d7f1-cd06-48e1-b481-3633461f0922, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=15b4d7f1-cd06-48e1-b481-3633461f0922,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:19.256966 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Sync routers for ids ['3521649d-4274-4082-9043-224fe9728321'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:16:19.267924 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Routers {'3521649d-4274-4082-9043-224fe9728321'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:16:19.268415 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:16:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['3521649d-4274-4082-9043-224fe9728321'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:16:19.272889 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-808d3a14-718b-4d5c-b125-8425c3c4b8cc req-eea1d32a-85fc-422f-916c-3cc7f7ab9697 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696640 Nov 24 11:16:19.471437 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:19.547962 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Set router 3521649d-4274-4082-9043-224fe9728321 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:16:19.577761 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 55164) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:19.580160 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Pushing event updated for resources: {'Port': ['ID=15b4d7f1-cd06-48e1-b481-3633461f0922,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:19.599213 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f4e836ad-ecfe-4bc6-8482-cbafb073d9f6 req-9213216a-3749-4388-982a-7824fc316539 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 210 time: 0.0377309 Nov 24 11:16:19.812758 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f9f1d435-e38d-4f21-8501-5368733e77f6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:19.858301 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3521649d-4274-4082-9043-224fe9728321', 'name': 'tempest-ServerRescueNegativeTestJSON-1610280202-router', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157'}], 'enable_snat': True}, 'gw_port_id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:16:13Z', 'updated_at': '2021-11-24T11:16:16Z', 'revision_number': 4, 'project_id': '30efcb46099b42a3a76be0d52d0d0213', 'gw_port': {'id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:d0:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3521649d-4274-4082-9043-224fe9728321', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:16:14Z', 'updated_at': '2021-11-24T11:16:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3bd5a5b3-3819-40e6-8486-0b27d5b77365', 'name': '', 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'mac_address': 'fa:16:3e:c6:f2:43', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3521649d-4274-4082-9043-224fe9728321', 'device_owner': 'network:router_interface', 'standard_attr_id': 276, 'fixed_ips': [{'subnet_id': 'e89fe7df-9fbd-43c3-9f7a-0597324b938f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:16:16Z', 'updated_at': '2021-11-24T11:16:17Z', 'revision_number': 2, 'project_id': '30efcb46099b42a3a76be0d52d0d0213', 'subnets': [{'id': 'e89fe7df-9fbd-43c3-9f7a-0597324b938f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:16:19.888199 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Checking router: 3521649d-4274-4082-9043-224fe9728321 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:16:19.888566 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Updating router 3521649d-4274-4082-9043-224fe9728321 port 3bd5a5b3-3819-40e6-8486-0b27d5b77365 binding host dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:16:19.909694 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f9f1d435-e38d-4f21-8501-5368733e77f6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:19.921174 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:19.959269 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-19d6baac-8d60-47f4-b2d2-b2f0f02a5fff tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:19.961883 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-19d6baac-8d60-47f4-b2d2-b2f0f02a5fff tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/networks?id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a HTTP/1.1" status: 200 len: 819 time: 0.1195965 Nov 24 11:16:19.974067 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f9f1d435-e38d-4f21-8501-5368733e77f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:19.985158 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-44c04790-2b83-409d-bbd9-34765ca4a73b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/quotas/30efcb46099b42a3a76be0d52d0d0213 HTTP/1.1" status: 200 len: 375 time: 0.0093875 Nov 24 11:16:20.020140 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-f9f1d435-e38d-4f21-8501-5368733e77f6 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=6262482667c54e32810b8a949ac7f9e8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4381893 Nov 24 11:16:20.021482 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 55198) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:20.038390 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9f1d435-e38d-4f21-8501-5368733e77f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88382e08-c63e-461d-a8a4-04c567d1a42e,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:20.051911 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-25a490bb-dd26-4b91-84aa-3d396fd576b2 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=30efcb46099b42a3a76be0d52d0d0213&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0690169 Nov 24 11:16:20.194031 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b67ff371-fbd4-4da1-a10d-bafd2c26fd13 req-7f163a8a-ca5f-4943-9138-67e1624e78c2 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:20.195596 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b67ff371-fbd4-4da1-a10d-bafd2c26fd13 req-7f163a8a-ca5f-4943-9138-67e1624e78c2 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 949 time: 0.1427586 Nov 24 11:16:20.199813 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b124d736-8955-4a76-98ca-037798475a8b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:20.234098 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Publish callbacks [] for port, precommit_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:20.250838 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b124d736-8955-4a76-98ca-037798475a8b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:20.254619 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-c375dda4-07a2-4e53-bb51-4dc9066d1972 service neutron] 10.222.0.76 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1973865 Nov 24 11:16:20.347746 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:20.368461 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b67ff371-fbd4-4da1-a10d-bafd2c26fd13 req-1bfbb7d7-f2d8-412c-aaf8-4d8b8cc5c80d tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1618600 Nov 24 11:16:20.418730 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7752b814-5087-40ad-9cd3-2f1481c0aed9 None None] Pushing event updated for resources: {'Port': ['ID=3bd5a5b3-3819-40e6-8486-0b27d5b77365,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:20.419842 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-8547fc10-09d4-4da6-bcfe-4115a545b970 service neutron] 10.222.0.76 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1577048 Nov 24 11:16:20.478975 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Attempting to bind port 3bd5a5b3-3819-40e6-8486-0b27d5b77365 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:16:20.479456 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Attempting to bind port 3bd5a5b3-3819-40e6-8486-0b27d5b77365 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:16:20.479891 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Attempting to bind port 3bd5a5b3-3819-40e6-8486-0b27d5b77365 on network b21f02d2-c533-4fb1-acd2-d2fd73a5180a {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:16:20.485169 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 16, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:16:20.489361 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Checking segment: {'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:16:20.489361 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:20.489361 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Bound using segment: {'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:16:20.489361 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Bound port: 3bd5a5b3-3819-40e6-8486-0b27d5b77365, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:16:20.489361 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:20.502578 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:16:20.513521 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36e5a8c-5c53-4b88-9e75-a93809717ac3 req-c80da43c-b0ec-4df9-b31a-f49ef1dd23e1 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:20.514821 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d36e5a8c-5c53-4b88-9e75-a93809717ac3 req-c80da43c-b0ec-4df9-b31a-f49ef1dd23e1 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 946 time: 0.0544248 Nov 24 11:16:20.541623 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b124d736-8955-4a76-98ca-037798475a8b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:20.544264 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b124d736-8955-4a76-98ca-037798475a8b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:20.546375 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-b124d736-8955-4a76-98ca-037798475a8b admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/88382e08-c63e-461d-a8a4-04c567d1a42e HTTP/1.1" status: 204 len: 168 time: 0.5200274 Nov 24 11:16:20.564976 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b124d736-8955-4a76-98ca-037798475a8b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88382e08-c63e-461d-a8a4-04c567d1a42e,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:20.648224 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d36e5a8c-5c53-4b88-9e75-a93809717ac3 req-b6f7676b-9432-4ca7-bfd0-a9ed87011a3e tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1240258 Nov 24 11:16:20.713518 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] For port 3bd5a5b3-3819-40e6-8486-0b27d5b77365, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:16:20.722880 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] For port 3bd5a5b3-3819-40e6-8486-0b27d5b77365, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=3bd5a5b3-3819-40e6-8486-0b27d5b77365,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:16:20.725482 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-532b041c-d5c4-43b8-b9f2-67b45a44c71c req-4b8e0912-f6d4-47e3-9cbb-8bb3a4324641 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 210 time: 0.0742908 Nov 24 11:16:20.803944 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:16:20.815210 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:20.822143 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:16:20.822857 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:20.940527 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Routers {'3521649d-4274-4082-9043-224fe9728321'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:16:20.941036 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:16:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['3521649d-4274-4082-9043-224fe9728321'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:16:20.993568 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 15b4d7f1-cd06-48e1-b481-3633461f0922 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:16:21.000485 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7752b814-5087-40ad-9cd3-2f1481c0aed9 None None] Pushing event updated for resources: {'Port': ['ID=3bd5a5b3-3819-40e6-8486-0b27d5b77365,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:21.150519 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:21.175723 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] Set router 3521649d-4274-4082-9043-224fe9728321 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:16:21.204108 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 15b4d7f1-cd06-48e1-b481-3633461f0922 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:16:21.204477 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:21.259503 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a7c8efee-bf60-46b8-84d0-45c8b0acae17', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:16:21.259503 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f3ccffd-40e0-4f9a-bb7e-224c34c21672" -d '{"events": [{"server_uuid": "a7c8efee-bf60-46b8-84d0-45c8b0acae17", "name": "network-vif-plugged", "status": "completed", "tag": "bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:16:21.280411 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce,segment=NetworkSegment(cd60819a-febf-4221-b2e4-966d325c3c03),segment_id=cd60819a-febf-4221-b2e4-966d325c3c03)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:21.347479 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:21.386437 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:16:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07fd026a-2fe0-432a-b43e-3dcb4d7d355d x-openstack-request-id: req-07fd026a-2fe0-432a-b43e-3dcb4d7d355d {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:16:21.386756 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a7c8efee-bf60-46b8-84d0-45c8b0acae17", "name": "network-vif-plugged", "status": "completed", "tag": "bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:16:21.387232 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-07fd026a-2fe0-432a-b43e-3dcb4d7d355d {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:16:21.387666 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a7c8efee-bf60-46b8-84d0-45c8b0acae17', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce', 'code': 200} Nov 24 11:16:21.507102 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:21.577457 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3521649d-4274-4082-9043-224fe9728321', 'name': 'tempest-ServerRescueNegativeTestJSON-1610280202-router', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157'}], 'enable_snat': True}, 'gw_port_id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:16:13Z', 'updated_at': '2021-11-24T11:16:16Z', 'revision_number': 4, 'project_id': '30efcb46099b42a3a76be0d52d0d0213', 'gw_port': {'id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:d0:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3521649d-4274-4082-9043-224fe9728321', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:16:14Z', 'updated_at': '2021-11-24T11:16:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3bd5a5b3-3819-40e6-8486-0b27d5b77365', 'name': '', 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'mac_address': 'fa:16:3e:c6:f2:43', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3521649d-4274-4082-9043-224fe9728321', 'device_owner': 'network:router_interface', 'standard_attr_id': 276, 'fixed_ips': [{'subnet_id': 'e89fe7df-9fbd-43c3-9f7a-0597324b938f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:16:16Z', 'updated_at': '2021-11-24T11:16:20Z', 'revision_number': 4, 'project_id': '30efcb46099b42a3a76be0d52d0d0213', 'subnets': [{'id': 'e89fe7df-9fbd-43c3-9f7a-0597324b938f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:16:21.578911 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9234ffcb-30ae-4c6d-a40c-1763faa77016 req-4c832b02-17a9-49ec-bb8e-3321ce976b99 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:21.586259 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9234ffcb-30ae-4c6d-a40c-1763faa77016 req-4c832b02-17a9-49ec-bb8e-3321ce976b99 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 950 time: 0.1091728 Nov 24 11:16:21.608434 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c93faf0b-0fe5-4db3-8b37-42584b92a01d None None] The sync data for ids ['3521649d-4274-4082-9043-224fe9728321'] in dv-cinder-804035-18-iscsi is: [{'id': '3521649d-4274-4082-9043-224fe9728321', 'name': 'tempest-ServerRescueNegativeTestJSON-1610280202-router', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157'}], 'enable_snat': True}, 'gw_port_id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:16:13Z', 'updated_at': '2021-11-24T11:16:16Z', 'revision_number': 4, 'project_id': '30efcb46099b42a3a76be0d52d0d0213', 'gw_port': {'id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:d0:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3521649d-4274-4082-9043-224fe9728321', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:16:14Z', 'updated_at': '2021-11-24T11:16:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3bd5a5b3-3819-40e6-8486-0b27d5b77365', 'name': '', 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'mac_address': 'fa:16:3e:c6:f2:43', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3521649d-4274-4082-9043-224fe9728321', 'device_owner': 'network:router_interface', 'standard_attr_id': 276, 'fixed_ips': [{'subnet_id': 'e89fe7df-9fbd-43c3-9f7a-0597324b938f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:16:16Z', 'updated_at': '2021-11-24T11:16:20Z', 'revision_number': 4, 'project_id': '30efcb46099b42a3a76be0d52d0d0213', 'subnets': [{'id': 'e89fe7df-9fbd-43c3-9f7a-0597324b938f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:16:21.633902 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9234ffcb-30ae-4c6d-a40c-1763faa77016 req-6aaed19e-affb-467e-bc6f-788d111a07f0 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468001 Nov 24 11:16:21.827938 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 55284) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:21.863709 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640d1d7d-aff4-4b05-bbb4-58839120e875 req-667c33f3-a4bb-43b7-a66e-07932a164b97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:21.865740 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-640d1d7d-aff4-4b05-bbb4-58839120e875 req-667c33f3-a4bb-43b7-a66e-07932a164b97 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 1103 time: 0.1160040 Nov 24 11:16:21.957253 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-640d1d7d-aff4-4b05-bbb4-58839120e875 req-8072d0d1-cdf9-4972-ace1-d8b12bd2421e service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0824759 Nov 24 11:16:21.977053 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bf8f9327-42e5-4d6e-b268-da9cc613c858 req-ec2b0893-2c8f-4ab6-ad1d-152af03b8908 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 210 time: 0.0679009 Nov 24 11:16:22.167062 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-eef1702b-5af2-4757-9948-c9ccbfb2fba3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:22.167062 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-eef1702b-5af2-4757-9948-c9ccbfb2fba3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:22.505859 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-eef1702b-5af2-4757-9948-c9ccbfb2fba3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:22.556640 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 55298) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:22.556924 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-eef1702b-5af2-4757-9948-c9ccbfb2fba3 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=640a850db8534c63af3a227b296eb131&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7271554 Nov 24 11:16:22.558040 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eef1702b-5af2-4757-9948-c9ccbfb2fba3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2892aa3a-bc5a-4da4-a702-151fb1297bb0,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:22.683234 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-afde545f-e314-4067-9613-67f58f60b366 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:22.717535 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-afde545f-e314-4067-9613-67f58f60b366 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:22.810449 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b66fdf76-3e20-4ba0-9882-04d6aff34376 req-9f6ae86d-763d-4ca7-9279-a68befbe358e tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:22.812030 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b66fdf76-3e20-4ba0-9882-04d6aff34376 req-9f6ae86d-763d-4ca7-9279-a68befbe358e tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 950 time: 0.0679379 Nov 24 11:16:22.895674 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-afde545f-e314-4067-9613-67f58f60b366 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:22.898600 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-afde545f-e314-4067-9613-67f58f60b366 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:22.900873 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-afde545f-e314-4067-9613-67f58f60b366 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/2892aa3a-bc5a-4da4-a702-151fb1297bb0 HTTP/1.1" status: 204 len: 168 time: 0.3421955 Nov 24 11:16:22.906990 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b66fdf76-3e20-4ba0-9882-04d6aff34376 req-6db69f1e-9354-4562-a050-eba487de400a tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0876052 Nov 24 11:16:22.936264 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afde545f-e314-4067-9613-67f58f60b366 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2892aa3a-bc5a-4da4-a702-151fb1297bb0,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:23.041401 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 3bd5a5b3-3819-40e6-8486-0b27d5b77365 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:16:23.125868 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 3bd5a5b3-3819-40e6-8486-0b27d5b77365 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:16:23.126469 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:23.167199 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a0e3fa2a-a633-43df-8ec3-44373df2e2e8 req-74f26972-a32f-44db-a13a-c6fc1be4ca74 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 210 time: 0.0745604 Nov 24 11:16:23.206602 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ec913feb-1682-4db8-834c-38ee1a7b264d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:23.208497 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ec913feb-1682-4db8-834c-38ee1a7b264d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.86 "GET /v2.0/networks?id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a HTTP/1.1" status: 200 len: 819 time: 0.2265656 Nov 24 11:16:23.232113 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Request body: {'port': {'device_id': '1a160f50-082e-4f8c-8483-fe7d8b41501e', 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a', 'admin_state_up': True, 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:23.354704 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:23.430051 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] For port 3bd5a5b3-3819-40e6-8486-0b27d5b77365, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=3bd5a5b3-3819-40e6-8486-0b27d5b77365,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:23.586553 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:23.587929 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Made reservation on behalf of 30efcb46099b42a3a76be0d52d0d0213 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:16:23.598944 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:23.656710 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Pushing event updated for resources: {'Port': ['ID=3bd5a5b3-3819-40e6-8486-0b27d5b77365,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:23.834969 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-afcae391-b82d-4b2d-83dc-ed2041bbda1d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:23.836515 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-afcae391-b82d-4b2d-83dc-ed2041bbda1d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.86 "GET /v2.0/networks?id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a HTTP/1.1" status: 200 len: 819 time: 0.2028387 Nov 24 11:16:23.854273 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Request body: {'port': {'device_id': '9395c84b-5176-4a1b-a13c-dc62c8222c1a', 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a', 'admin_state_up': True, 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:23.862207 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Allocated IP 172.20.0.14 (b21f02d2-c533-4fb1-acd2-d2fd73a5180a/e89fe7df-9fbd-43c3-9f7a-0597324b938f/bc9cf739-16b6-4224-a3fd-869dd9adb0f4) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:16:23.904612 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 55406) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:23.932790 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-669c4175-09b4-4f9a-949a-fe642429f9e3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:24.111326 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-669c4175-09b4-4f9a-949a-fe642429f9e3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:24.137234 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:24.152411 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Made reservation on behalf of 30efcb46099b42a3a76be0d52d0d0213 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:16:24.158301 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:24.165894 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f163df01-f3ab-4abd-b1a5-b7d49b8b0243 req-56d71908-5dd8-4cb4-963e-e912342c4b30 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:24.179378 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f163df01-f3ab-4abd-b1a5-b7d49b8b0243 req-56d71908-5dd8-4cb4-963e-e912342c4b30 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 950 time: 0.1346235 Nov 24 11:16:24.182242 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-669c4175-09b4-4f9a-949a-fe642429f9e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:24.245849 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-669c4175-09b4-4f9a-949a-fe642429f9e3 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=361af6fb3990433aba51aa60efd4d97f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3376985 Nov 24 11:16:24.249185 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 55426) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:24.263269 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-669c4175-09b4-4f9a-949a-fe642429f9e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=30b41474-c91e-46c2-9598-052986af32b5,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:24.315393 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:24.332131 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f163df01-f3ab-4abd-b1a5-b7d49b8b0243 req-48e7be12-8a66-4f3a-b0a9-5170f9c6c014 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1511841 Nov 24 11:16:24.335867 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-98486802-7859-4a6d-8405-09eb0fd01c15 req-1708b4fe-d7a4-4dbb-b666-0ebbab719bbf tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 210 time: 0.0539675 Nov 24 11:16:24.360016 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0308435a-d37c-47e0-8ff7-ad5f0b164c84 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:24.389998 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0308435a-d37c-47e0-8ff7-ad5f0b164c84 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:24.431419 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Network b21f02d2-c533-4fb1-acd2-d2fd73a5180a is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:16:24.438303 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:16:24.446213 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:16:24.452239 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:24.453472 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:24.467621 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Pushing event updated for resources: {'Port': ['ID=bc9cf739-16b6-4224-a3fd-869dd9adb0f4,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:24.523800 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.db.api [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Retry wrapper got retriable exception: Failed to create a duplicate IpamAllocation: for attribute(s) ['ipamallocations.PRIMARY'] with value(s) 172.20.0.14-f62fff2e-96d2-4312-97f2-5c3f28927ef6 {{(pid=103243) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 24 11:16:24.524167 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG oslo_db.api [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.create_port {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 24 11:16:24.541494 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e008f6-d01c-4525-a5c8-593d643f953d req-d7cc2d1d-7f5b-4a9b-b70a-8d7f2a0ae06a tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:24.542982 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-d7cc2d1d-7f5b-4a9b-b70a-8d7f2a0ae06a tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/networks?id=8558262b-7125-4688-a6ea-2f1d2c3b2876 HTTP/1.1" status: 200 len: 815 time: 0.1231172 Nov 24 11:16:24.559108 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-f08c8289-9cd8-4b41-a330-4b5605e74e5a tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/quotas/fae8312f669b48b797904792401edfa4 HTTP/1.1" status: 200 len: 375 time: 0.0095534 Nov 24 11:16:24.559779 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-ef896ad4-5aa2-48c9-9ead-659ed9e177df tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3371618 Nov 24 11:16:24.575596 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Request body: {'port': {'device_id': '1a160f50-082e-4f8c-8483-fe7d8b41501e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:24.622023 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0308435a-d37c-47e0-8ff7-ad5f0b164c84 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:24.624766 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0308435a-d37c-47e0-8ff7-ad5f0b164c84 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:24.628715 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-0308435a-d37c-47e0-8ff7-ad5f0b164c84 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/30b41474-c91e-46c2-9598-052986af32b5 HTTP/1.1" status: 204 len: 168 time: 0.3758008 Nov 24 11:16:24.637577 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:24.645143 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-9ebdf7f8-9405-4c1d-a621-c57e737f6602 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0800862 Nov 24 11:16:24.668523 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0308435a-d37c-47e0-8ff7-ad5f0b164c84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=30b41474-c91e-46c2-9598-052986af32b5,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:24.793538 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-8604b353-6eaf-4705-9dbc-db257a03a7dc service neutron] 10.222.0.76 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1474376 Nov 24 11:16:24.911357 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-afcc3745-3d24-4df5-8966-92c6e7e279bb service neutron] 10.222.0.76 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1100862 Nov 24 11:16:24.959146 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 3bd5a5b3-3819-40e6-8486-0b27d5b77365 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:16:25.026910 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:25.039234 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bc9cf739-16b6-4224-a3fd-869dd9adb0f4 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:16:25.048051 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 3bd5a5b3-3819-40e6-8486-0b27d5b77365 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:16:25.048426 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:25.053237 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:25.088229 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Transition to ACTIVE for port object bc9cf739-16b6-4224-a3fd-869dd9adb0f4 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:16:25.195759 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:25.322012 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Allocated IP 172.20.0.13 (b21f02d2-c533-4fb1-acd2-d2fd73a5180a/e89fe7df-9fbd-43c3-9f7a-0597324b938f/6cf63bf9-c3aa-422b-a4f0-c496f8b73423) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:16:25.323977 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e95ef390-d08b-4156-9c77-8894eb8c783a req-60d63c08-fc7b-4bbd-9a81-0825ddf42133 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 210 time: 0.0523689 Nov 24 11:16:25.340278 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae27282-6fe2-41c5-a868-ffe412d12170 req-cad66273-a680-4801-b03f-c9c5d107ea0a tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:25.348067 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cae27282-6fe2-41c5-a868-ffe412d12170 req-cad66273-a680-4801-b03f-c9c5d107ea0a tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 950 time: 0.1345360 Nov 24 11:16:25.429709 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cae27282-6fe2-41c5-a868-ffe412d12170 req-6b328f69-ea0f-4b96-acd7-b989c54b847a tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0807078 Nov 24 11:16:25.458356 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c63acc01-27f5-41f3-8f50-911f34a648c4 req-c7e3470b-52ca-4fd0-bb8a-f4acba5b7e23 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 210 time: 0.0335784 Nov 24 11:16:25.476092 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Pushing event updated for resources: {'Port': ['ID=bc9cf739-16b6-4224-a3fd-869dd9adb0f4,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:25.517976 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Attempting to bind port bc9cf739-16b6-4224-a3fd-869dd9adb0f4 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:16:25.518486 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Attempting to bind port bc9cf739-16b6-4224-a3fd-869dd9adb0f4 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:16:25.518806 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Attempting to bind port bc9cf739-16b6-4224-a3fd-869dd9adb0f4 on network b21f02d2-c533-4fb1-acd2-d2fd73a5180a {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:16:25.526570 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Port bc9cf739-16b6-4224-a3fd-869dd9adb0f4 on network b21f02d2-c533-4fb1-acd2-d2fd73a5180a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:16:25.526812 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Attempting to bind port bc9cf739-16b6-4224-a3fd-869dd9adb0f4 on network b21f02d2-c533-4fb1-acd2-d2fd73a5180a {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:16:25.539528 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 16, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:16:25.540200 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Checking segment: {'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:16:25.540662 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Bound using segment: {'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:16:25.541152 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Bound port: bc9cf739-16b6-4224-a3fd-869dd9adb0f4, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:16:25.541567 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:25.600116 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:25.649409 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] For port bc9cf739-16b6-4224-a3fd-869dd9adb0f4, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:16:25.664454 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] For port bc9cf739-16b6-4224-a3fd-869dd9adb0f4, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=bc9cf739-16b6-4224-a3fd-869dd9adb0f4,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:16:25.759516 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:25.764399 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:25.805167 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:25.805941 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:25.807571 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] 10.222.0.86 "PUT /v2.0/ports/bc9cf739-16b6-4224-a3fd-869dd9adb0f4 HTTP/1.1" status: 200 len: 1094 time: 1.2362006 Nov 24 11:16:25.813094 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1a160f50-082e-4f8c-8483-fe7d8b41501e', 'tag': 'bc9cf739-16b6-4224-a3fd-869dd9adb0f4'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:16:25.816515 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-058fb803-141b-4f2a-b742-0a81f92da608" -d '{"events": [{"name": "network-changed", "server_uuid": "1a160f50-082e-4f8c-8483-fe7d8b41501e", "tag": "bc9cf739-16b6-4224-a3fd-869dd9adb0f4"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:16:25.833258 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Network b21f02d2-c533-4fb1-acd2-d2fd73a5180a is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:16:25.851702 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:16:25.855183 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:16:25.861156 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:25.861780 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:25.867715 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf85ccc1-9260-4000-a8f1-1033fb9c6414 service neutron] Pushing event updated for resources: {'Port': ['ID=bc9cf739-16b6-4224-a3fd-869dd9adb0f4,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:25.898108 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:16:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-24f70088-030f-4211-90a9-50c6a5528346 x-openstack-request-id: req-24f70088-030f-4211-90a9-50c6a5528346 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:16:25.898400 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1a160f50-082e-4f8c-8483-fe7d8b41501e", "tag": "bc9cf739-16b6-4224-a3fd-869dd9adb0f4", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:16:25.898658 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-24f70088-030f-4211-90a9-50c6a5528346 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:16:25.899066 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1a160f50-082e-4f8c-8483-fe7d8b41501e', 'tag': 'bc9cf739-16b6-4224-a3fd-869dd9adb0f4', 'status': 'completed', 'code': 200} Nov 24 11:16:25.942609 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Pushing event updated for resources: {'Port': ['ID=6cf63bf9-c3aa-422b-a4f0-c496f8b73423,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:25.963760 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-058fb803-141b-4f2a-b742-0a81f92da608 req-16871848-f70e-460e-b040-9b31a8a47447 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:25.965314 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-058fb803-141b-4f2a-b742-0a81f92da608 req-16871848-f70e-460e-b040-9b31a8a47447 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=30efcb46099b42a3a76be0d52d0d0213&device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 1097 time: 0.0511825 Nov 24 11:16:26.026214 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-6a6c7b60-1f41-4530-b2d0-15e487ddfd67 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.1773794 Nov 24 11:16:26.071637 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Request body: {'port': {'device_id': '9395c84b-5176-4a1b-a13c-dc62c8222c1a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:26.154964 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-058fb803-141b-4f2a-b742-0a81f92da608 req-a434a12a-a59d-428e-aa97-2ef17d292e2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:26.165317 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-058fb803-141b-4f2a-b742-0a81f92da608 req-a434a12a-a59d-428e-aa97-2ef17d292e2e service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=30efcb46099b42a3a76be0d52d0d0213&shared=False HTTP/1.1" status: 200 len: 921 time: 0.1819830 Nov 24 11:16:26.166224 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:26.423204 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dc6a95f9-a0ea-48b8-8d8e-3667f07b797d req-c24f60c6-e343-4d32-b0d6-5ed8409da945 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 210 time: 0.0291874 Nov 24 11:16:26.622405 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-058fb803-141b-4f2a-b742-0a81f92da608 req-1f234046-2767-40d4-b616-3b92d8dc0b65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:26.623838 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-058fb803-141b-4f2a-b742-0a81f92da608 req-1f234046-2767-40d4-b616-3b92d8dc0b65 service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.2017524 Nov 24 11:16:26.629087 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da76e9d-100a-43aa-b58a-4e0c3cc93266 req-9c2a3acb-79bd-4ec2-a945-a2b91a2cbc0f tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:26.630677 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4da76e9d-100a-43aa-b58a-4e0c3cc93266 req-9c2a3acb-79bd-4ec2-a945-a2b91a2cbc0f tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 932 time: 0.0870488 Nov 24 11:16:26.648680 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1017aeef-8a22-44f2-8d11-e85942d2ac1b req-7204b2cb-5075-4da8-82b2-68f2c1421228 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:26.650603 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1017aeef-8a22-44f2-8d11-e85942d2ac1b req-7204b2cb-5075-4da8-82b2-68f2c1421228 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 950 time: 0.0770271 Nov 24 11:16:26.741512 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4da76e9d-100a-43aa-b58a-4e0c3cc93266 req-6db52709-47dc-4451-bae8-14b778bd4f5f tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0892837 Nov 24 11:16:26.763014 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1017aeef-8a22-44f2-8d11-e85942d2ac1b req-c97cc645-5202-4742-935e-04393ee5c981 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/security-groups?id=480ab1d3-b975-419a-89c0-5a2ddd41c025&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1023934 Nov 24 11:16:26.877595 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf1fcdb5-dfeb-4cbc-bdb2-8371ff5dc62d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:26.879021 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-cf1fcdb5-dfeb-4cbc-bdb2-8371ff5dc62d service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=30efcb46099b42a3a76be0d52d0d0213&device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 1097 time: 0.1560440 Nov 24 11:16:26.897669 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:16:26.935736 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:26.940051 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-0cf66639-89c8-47cf-8c88-b462663f1ecb service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bc9cf739-16b6-4224-a3fd-869dd9adb0f4 HTTP/1.1" status: 200 len: 217 time: 0.0510521 Nov 24 11:16:26.953586 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Transition to ACTIVE for port object 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:16:27.033946 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:27.039848 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-8963bfd0-5bdd-4a0b-9fa3-03d748d5225f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:27.041405 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-8963bfd0-5bdd-4a0b-9fa3-03d748d5225f service neutron] 10.222.0.86 "GET /v2.0/subnets?id=e89fe7df-9fbd-43c3-9f7a-0597324b938f HTTP/1.1" status: 200 len: 859 time: 0.0622916 Nov 24 11:16:27.047862 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2fde097-d94b-40eb-b042-4bfca05fc33b req-3fa14f1a-78e4-49ca-9c3f-d8209d725957 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:27.047862 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b2fde097-d94b-40eb-b042-4bfca05fc33b req-3fa14f1a-78e4-49ca-9c3f-d8209d725957 tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.86 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 950 time: 0.0667694 Nov 24 11:16:27.116943 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-de7bedb2-23ba-47fc-8e75-4cb258dd1975 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0424585 Nov 24 11:16:27.126648 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Pushing event updated for resources: {'Port': ['ID=6cf63bf9-c3aa-422b-a4f0-c496f8b73423,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:27.201360 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Attempting to bind port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:16:27.201951 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Attempting to bind port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:16:27.202283 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Attempting to bind port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 on network b21f02d2-c533-4fb1-acd2-d2fd73a5180a {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:16:27.252834 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 on network b21f02d2-c533-4fb1-acd2-d2fd73a5180a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:16:27.253412 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Attempting to bind port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 on network b21f02d2-c533-4fb1-acd2-d2fd73a5180a {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:16:27.272946 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [req-b2fde097-d94b-40eb-b042-4bfca05fc33b req-603f2e7c-d3c6-4ff5-8d74-38f59e2e9aae tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Deleting port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:16:27.273632 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 16, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:16:27.273748 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-b2fde097-d94b-40eb-b042-4bfca05fc33b req-603f2e7c-d3c6-4ff5-8d74-38f59e2e9aae tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:27.273839 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Checking segment: {'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:16:27.273839 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Bound using segment: {'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:16:27.273839 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Bound port: 6cf63bf9-c3aa-422b-a4f0-c496f8b73423, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a796222b-4203-47ee-8ece-5d33e9d64672', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1226, 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:16:27.273839 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:27.320488 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-976ccbf1-3091-4351-a7af-931828114519 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1896904 Nov 24 11:16:27.424829 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [req-b2fde097-d94b-40eb-b042-4bfca05fc33b req-603f2e7c-d3c6-4ff5-8d74-38f59e2e9aae tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] For port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce,segment=NetworkSegment(cd60819a-febf-4221-b2e4-966d325c3c03),segment_id=cd60819a-febf-4221-b2e4-966d325c3c03)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:27.425429 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-b2fde097-d94b-40eb-b042-4bfca05fc33b req-603f2e7c-d3c6-4ff5-8d74-38f59e2e9aae tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:27.432803 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] For port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:16:27.442139 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [req-b2fde097-d94b-40eb-b042-4bfca05fc33b req-603f2e7c-d3c6-4ff5-8d74-38f59e2e9aae tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Calling delete_port for bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce owned by compute:nova {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:16:27.452157 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] For port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=6cf63bf9-c3aa-422b-a4f0-c496f8b73423,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:16:27.475202 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90334cfa-5d11-4621-8e11-0ff943c039b3 req-24986fb9-9439-4e41-9ab5-6ec0e9bbc703 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1447132 Nov 24 11:16:27.511892 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:27.548969 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3cdf88f7-a78b-4d20-84c2-edae7db5cb0e req-e81a03e8-e9c6-4dc8-9a66-8aadb0e68e2e tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 210 time: 0.0329056 Nov 24 11:16:27.584709 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:27.585492 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:27.587006 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] 10.222.0.86 "PUT /v2.0/ports/6cf63bf9-c3aa-422b-a4f0-c496f8b73423 HTTP/1.1" status: 200 len: 1094 time: 1.5492818 Nov 24 11:16:27.644614 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c4b8a8e-6a3e-44de-aef7-c253c36cf3e1 service neutron] Pushing event updated for resources: {'Port': ['ID=6cf63bf9-c3aa-422b-a4f0-c496f8b73423,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:27.686398 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e008f6-d01c-4525-a5c8-593d643f953d req-c9c1bd46-dedc-4381-90e0-4b2edcff874c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:27.687861 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-c9c1bd46-dedc-4381-90e0-4b2edcff874c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "GET /v2.0/networks?id=8558262b-7125-4688-a6ea-2f1d2c3b2876 HTTP/1.1" status: 200 len: 815 time: 0.1441259 Nov 24 11:16:27.689879 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-b2fde097-d94b-40eb-b042-4bfca05fc33b req-603f2e7c-d3c6-4ff5-8d74-38f59e2e9aae tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:27.709341 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:16:27.711239 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-62e008f6-d01c-4525-a5c8-593d643f953d req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Request body: {'port': {'device_id': '1b563a6c-0dc5-4560-941a-74894bab54c5', 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876', 'admin_state_up': True, 'tenant_id': 'fae8312f669b48b797904792401edfa4'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:27.770003 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-603f2e7c-d3c6-4ff5-8d74-38f59e2e9aae tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Pushing event deleted for resources: {'Port': ['ID=bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:27.848322 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-e7b26891-5c4d-421e-b742-aac89be1504a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:27.851225 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-e7b26891-5c4d-421e-b742-aac89be1504a service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=30efcb46099b42a3a76be0d52d0d0213&device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 1097 time: 0.1336272 Nov 24 11:16:27.856365 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 55576) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:27.885314 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [req-b2fde097-d94b-40eb-b042-4bfca05fc33b req-603f2e7c-d3c6-4ff5-8d74-38f59e2e9aae tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] No DVR routers for this DVR port bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce on host hv-cinder-80403 {{(pid=103244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:16:27.902919 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-b2fde097-d94b-40eb-b042-4bfca05fc33b req-603f2e7c-d3c6-4ff5-8d74-38f59e2e9aae tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:27.906607 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b2fde097-d94b-40eb-b042-4bfca05fc33b req-603f2e7c-d3c6-4ff5-8d74-38f59e2e9aae tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.86 "DELETE /v2.0/ports/bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce HTTP/1.1" status: 204 len: 173 time: 0.8379195 Nov 24 11:16:27.914070 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a7c8efee-bf60-46b8-84d0-45c8b0acae17', 'name': 'network-vif-deleted', 'tag': 'bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:16:27.918253 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5dcc3e5-06e3-4f6a-ad36-092757034285" -d '{"events": [{"server_uuid": "a7c8efee-bf60-46b8-84d0-45c8b0acae17", "name": "network-vif-deleted", "tag": "bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:16:27.924549 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9395c84b-5176-4a1b-a13c-dc62c8222c1a', 'tag': '6cf63bf9-c3aa-422b-a4f0-c496f8b73423'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:16:27.926768 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-57a502f0-37b5-4c8b-ba62-dcec043de592" -d '{"events": [{"name": "network-changed", "server_uuid": "9395c84b-5176-4a1b-a13c-dc62c8222c1a", "tag": "6cf63bf9-c3aa-422b-a4f0-c496f8b73423"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:16:27.940002 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-01ded87d-e78f-4099-b310-0c2b257c9a47 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6cf63bf9-c3aa-422b-a4f0-c496f8b73423 HTTP/1.1" status: 200 len: 217 time: 0.0674438 Nov 24 11:16:27.995677 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8db741ba-0d7d-4529-b0d2-513319713225 req-cd634961-679c-485b-b55d-cf1805d10fbb tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 210 time: 0.0593736 Nov 24 11:16:28.041194 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-769de862-d9f2-4fc5-8a0e-45f5bd5268a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:28.044691 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-769de862-d9f2-4fc5-8a0e-45f5bd5268a6 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=e89fe7df-9fbd-43c3-9f7a-0597324b938f HTTP/1.1" status: 200 len: 859 time: 0.0935857 Nov 24 11:16:28.071367 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49d5915f-0d7c-4e74-bb0e-2b84e9112cee req-3a0ec3a4-0047-4154-afd7-94db83f9284c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:28.072958 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-49d5915f-0d7c-4e74-bb0e-2b84e9112cee req-3a0ec3a4-0047-4154-afd7-94db83f9284c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 944 time: 0.1346402 Nov 24 11:16:28.077232 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:16:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03e4fa07-c521-4d9a-ae84-fb44311ed06e x-openstack-request-id: req-03e4fa07-c521-4d9a-ae84-fb44311ed06e {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:16:28.077561 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a7c8efee-bf60-46b8-84d0-45c8b0acae17", "name": "network-vif-deleted", "tag": "bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:16:28.080203 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-03e4fa07-c521-4d9a-ae84-fb44311ed06e {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:16:28.080203 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a7c8efee-bf60-46b8-84d0-45c8b0acae17', 'name': 'network-vif-deleted', 'tag': 'bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce', 'status': 'completed', 'code': 200} Nov 24 11:16:28.113641 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c067c9f1-5e4e-40fb-9fe0-a78cc4e9ab2b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:28.113641 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-209dec3f-a59a-40b7-b7c2-cc80534254a2 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0536506 Nov 24 11:16:28.114856 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-62e008f6-d01c-4525-a5c8-593d643f953d req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Made reservation on behalf of fae8312f669b48b797904792401edfa4 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:16:28.118340 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-62e008f6-d01c-4525-a5c8-593d643f953d req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:28.131355 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-49d5915f-0d7c-4e74-bb0e-2b84e9112cee req-28140894-0e40-44ab-90fa-92dad0627d23 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481310 Nov 24 11:16:28.133957 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:16:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27022bce-f060-4985-91c2-0b33c2ff16b2 x-openstack-request-id: req-27022bce-f060-4985-91c2-0b33c2ff16b2 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:16:28.134243 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9395c84b-5176-4a1b-a13c-dc62c8222c1a", "tag": "6cf63bf9-c3aa-422b-a4f0-c496f8b73423", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:16:28.134492 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-27022bce-f060-4985-91c2-0b33c2ff16b2 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:16:28.134892 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9395c84b-5176-4a1b-a13c-dc62c8222c1a', 'tag': '6cf63bf9-c3aa-422b-a4f0-c496f8b73423', 'status': 'completed', 'code': 200} Nov 24 11:16:28.312805 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-5187fa4c-45c4-4edf-8454-6260c92737e3 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1864326 Nov 24 11:16:28.437457 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-62e008f6-d01c-4525-a5c8-593d643f953d req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Allocated IP 172.20.0.4 (8558262b-7125-4688-a6ea-2f1d2c3b2876/cd868cb4-b7fb-4350-b027-a21baabac768/4937438f-b5f9-45ee-9f52-e426878caa7d) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:16:28.460804 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c067c9f1-5e4e-40fb-9fe0-a78cc4e9ab2b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:28.481850 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dad0770d-695d-4f7e-99dd-1797c465e987 req-8ae92d2f-201d-4b2a-8cb3-d94279e1cde4 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1319802 Nov 24 11:16:28.534317 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c067c9f1-5e4e-40fb-9fe0-a78cc4e9ab2b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:28.616909 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-c067c9f1-5e4e-40fb-9fe0-a78cc4e9ab2b admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=1920708c9e0d423e85c2e518fafc28d4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7594852 Nov 24 11:16:28.619857 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 55596) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:28.621033 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c067c9f1-5e4e-40fb-9fe0-a78cc4e9ab2b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=58d624af-78b2-427f-9027-7548546d77c6,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:28.679418 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-39c3a151-5270-4eff-95e4-061dc5d62148 req-6e351d60-63bf-423e-b7ed-78fb0f6ddbd4 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 210 time: 0.0446060 Nov 24 11:16:28.690778 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-62e008f6-d01c-4525-a5c8-593d643f953d req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:28.697654 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a502f0-37b5-4c8b-ba62-dcec043de592 req-b118ae9f-7d18-4da7-b50e-74a2d23ea369 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:28.699160 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-57a502f0-37b5-4c8b-ba62-dcec043de592 req-b118ae9f-7d18-4da7-b50e-74a2d23ea369 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=30efcb46099b42a3a76be0d52d0d0213&device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 1097 time: 0.0792525 Nov 24 11:16:28.703252 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-128ccacc-da1c-4737-8a7b-0f99d5d5412a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:28.727152 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-128ccacc-da1c-4737-8a7b-0f99d5d5412a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:28.817974 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a502f0-37b5-4c8b-ba62-dcec043de592 req-318b8aee-6fa2-48ae-b942-8a23d7565d13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:28.819509 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-57a502f0-37b5-4c8b-ba62-dcec043de592 req-318b8aee-6fa2-48ae-b942-8a23d7565d13 service neutron] 10.222.0.86 "GET /v2.0/networks?id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a HTTP/1.1" status: 200 len: 921 time: 0.0974932 Nov 24 11:16:28.820888 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-62e008f6-d01c-4525-a5c8-593d643f953d req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:28.844786 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['af19a68f-fbb1-4d8c-9034-627d69f6dfd0', '5e1dd2e6-fe77-43bc-98bf-f1a63705734c'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:16:28.857922 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-128ccacc-da1c-4737-8a7b-0f99d5d5412a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:28.866049 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-128ccacc-da1c-4737-8a7b-0f99d5d5412a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:28.866049 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-128ccacc-da1c-4737-8a7b-0f99d5d5412a admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/58d624af-78b2-427f-9027-7548546d77c6 HTTP/1.1" status: 204 len: 168 time: 0.2430010 Nov 24 11:16:28.884928 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-128ccacc-da1c-4737-8a7b-0f99d5d5412a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=58d624af-78b2-427f-9027-7548546d77c6,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:28.908681 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-57a502f0-37b5-4c8b-ba62-dcec043de592 req-90104af2-a015-48a2-951d-7b1126f81ad5 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6cf63bf9-c3aa-422b-a4f0-c496f8b73423 HTTP/1.1" status: 200 len: 217 time: 0.0808945 Nov 24 11:16:28.910644 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-62e008f6-d01c-4525-a5c8-593d643f953d req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Network 8558262b-7125-4688-a6ea-2f1d2c3b2876 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:16:28.916172 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-62e008f6-d01c-4525-a5c8-593d643f953d req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:16:28.924525 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-62e008f6-d01c-4525-a5c8-593d643f953d req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:16:28.931087 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e008f6-d01c-4525-a5c8-593d643f953d req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:28.931921 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-62e008f6-d01c-4525-a5c8-593d643f953d req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:28.942701 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Pushing event updated for resources: {'Port': ['ID=4937438f-b5f9-45ee-9f52-e426878caa7d,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:28.987669 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57a502f0-37b5-4c8b-ba62-dcec043de592 req-fe27700f-d665-44c0-9833-bc06ebf06782 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:28.989178 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-57a502f0-37b5-4c8b-ba62-dcec043de592 req-fe27700f-d665-44c0-9833-bc06ebf06782 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=e89fe7df-9fbd-43c3-9f7a-0597324b938f HTTP/1.1" status: 200 len: 859 time: 0.0673528 Nov 24 11:16:29.040496 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-57a502f0-37b5-4c8b-ba62-dcec043de592 req-2dd4a041-3eb1-4f68-a4f1-ec64f1856a2b service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0428293 Nov 24 11:16:29.045782 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-4bd5cb98-7b9a-40a8-be20-4d523871f700 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3398097 Nov 24 11:16:29.081389 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Request body: {'port': {'device_id': '1b563a6c-0dc5-4560-941a-74894bab54c5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:16:29.143330 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-067b5101-f0b0-4f3b-ae80-23e49af27878 req-7568146f-46a5-4525-8a98-bb3e8d2b9edf tempest-VolumesNegativeTest-267106280 tempest-VolumesNegativeTest-267106280-project] 10.222.0.76 "GET /v2.0/ports?device_id=a7c8efee-bf60-46b8-84d0-45c8b0acae17 HTTP/1.1" status: 200 len: 210 time: 0.0407634 Nov 24 11:16:29.219018 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-57a502f0-37b5-4c8b-ba62-dcec043de592 req-c5063ea4-4d92-4b2a-9071-86017df28700 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1562216 Nov 24 11:16:29.220252 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:29.275415 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee2def3-ed4b-47cd-801c-d05e42c3f561 req-a1120af9-aa76-4276-970d-6188ccb246b5 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:29.276831 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9ee2def3-ed4b-47cd-801c-d05e42c3f561 req-a1120af9-aa76-4276-970d-6188ccb246b5 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 944 time: 0.0495896 Nov 24 11:16:29.339686 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9ee2def3-ed4b-47cd-801c-d05e42c3f561 req-dceb6351-987e-455d-a61e-9574ffbf25ce tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552278 Nov 24 11:16:29.416706 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-57a502f0-37b5-4c8b-ba62-dcec043de592 req-0c99d6af-9110-4953-8927-be71e225ba70 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1876068 Nov 24 11:16:29.573573 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4937438f-b5f9-45ee-9f52-e426878caa7d {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:16:29.581883 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:29.593820 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Transition to ACTIVE for port object 4937438f-b5f9-45ee-9f52-e426878caa7d will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:16:29.602166 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 55614) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:29.619091 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0f14cfcc-31fe-47d9-8aa5-df5e16e64ba0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:29.672488 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:29.730737 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0f14cfcc-31fe-47d9-8aa5-df5e16e64ba0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:29.742282 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Pushing event updated for resources: {'Port': ['ID=4937438f-b5f9-45ee-9f52-e426878caa7d,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:29.776756 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Attempting to bind port 4937438f-b5f9-45ee-9f52-e426878caa7d on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:16:29.777173 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Attempting to bind port 4937438f-b5f9-45ee-9f52-e426878caa7d by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:16:29.777561 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Attempting to bind port 4937438f-b5f9-45ee-9f52-e426878caa7d on network 8558262b-7125-4688-a6ea-2f1d2c3b2876 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:16:29.782033 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Port 4937438f-b5f9-45ee-9f52-e426878caa7d on network 8558262b-7125-4688-a6ea-2f1d2c3b2876 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:16:29.783035 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Attempting to bind port 4937438f-b5f9-45ee-9f52-e426878caa7d on network 8558262b-7125-4688-a6ea-2f1d2c3b2876 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:16:29.788216 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 16, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:16:29.788542 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Checking segment: {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:16:29.788913 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Bound using segment: {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:16:29.789329 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Bound port: 4937438f-b5f9-45ee-9f52-e426878caa7d, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:16:29.789681 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:29.792615 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0f14cfcc-31fe-47d9-8aa5-df5e16e64ba0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:29.818266 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d090d07-1624-4e37-97b0-02fdde209bef req-78518c8f-c707-4517-8d9f-115248e366d0 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:29.820693 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1d090d07-1624-4e37-97b0-02fdde209bef req-78518c8f-c707-4517-8d9f-115248e366d0 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0544574 Nov 24 11:16:29.863434 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f14cfcc-31fe-47d9-8aa5-df5e16e64ba0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74767246-ac1f-45e0-824c-577642c6f84c,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:29.874499 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-0f14cfcc-31fe-47d9-8aa5-df5e16e64ba0 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=533115de68fb4143b3099422fba119da&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2712295 Nov 24 11:16:29.875153 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 55618) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:29.879816 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1d090d07-1624-4e37-97b0-02fdde209bef req-1bf14bf3-3cbb-4c6b-8fb8-5b404ff53ced tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534959 Nov 24 11:16:29.920253 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] For port 4937438f-b5f9-45ee-9f52-e426878caa7d, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:16:29.923843 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] For port 4937438f-b5f9-45ee-9f52-e426878caa7d, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4937438f-b5f9-45ee-9f52-e426878caa7d,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:16:29.944386 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5bc3cf9c-9eb4-4297-b968-40256dbc59af admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:29.967094 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5bc3cf9c-9eb4-4297-b968-40256dbc59af admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:29.975441 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:30.031198 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:30.031676 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:30.033241 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] 10.222.0.86 "PUT /v2.0/ports/4937438f-b5f9-45ee-9f52-e426878caa7d HTTP/1.1" status: 200 len: 1093 time: 0.9605858 Nov 24 11:16:30.057709 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b30e20b7-201a-4b59-94f4-62be58a92060 service neutron] Pushing event updated for resources: {'Port': ['ID=4937438f-b5f9-45ee-9f52-e426878caa7d,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:30.121948 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5bc3cf9c-9eb4-4297-b968-40256dbc59af admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:30.124513 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5bc3cf9c-9eb4-4297-b968-40256dbc59af admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:30.125575 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-5bc3cf9c-9eb4-4297-b968-40256dbc59af admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/74767246-ac1f-45e0-824c-577642c6f84c HTTP/1.1" status: 204 len: 168 time: 0.2465026 Nov 24 11:16:30.141035 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1b563a6c-0dc5-4560-941a-74894bab54c5', 'tag': '4937438f-b5f9-45ee-9f52-e426878caa7d'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:16:30.143253 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebede7d6-11b8-44f3-a40f-f572583ceb97" -d '{"events": [{"name": "network-changed", "server_uuid": "1b563a6c-0dc5-4560-941a-74894bab54c5", "tag": "4937438f-b5f9-45ee-9f52-e426878caa7d"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:16:30.155708 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bc3cf9c-9eb4-4297-b968-40256dbc59af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74767246-ac1f-45e0-824c-577642c6f84c,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:30.169872 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e008f6-d01c-4525-a5c8-593d643f953d req-555b026f-f7bc-4e4f-b067-2f3b1f522e63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:30.171603 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-555b026f-f7bc-4e4f-b067-2f3b1f522e63 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 1096 time: 0.0588613 Nov 24 11:16:30.192994 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:16:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5323afa-b7af-4cb2-9fbc-8ba22e7f85b9 x-openstack-request-id: req-b5323afa-b7af-4cb2-9fbc-8ba22e7f85b9 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:16:30.198351 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1b563a6c-0dc5-4560-941a-74894bab54c5", "tag": "4937438f-b5f9-45ee-9f52-e426878caa7d", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:16:30.198351 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-b5323afa-b7af-4cb2-9fbc-8ba22e7f85b9 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:16:30.198351 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1b563a6c-0dc5-4560-941a-74894bab54c5', 'tag': '4937438f-b5f9-45ee-9f52-e426878caa7d', 'status': 'completed', 'code': 200} Nov 24 11:16:30.234446 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-6a6abcf9-30f7-4623-9634-8421368e579f service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=4937438f-b5f9-45ee-9f52-e426878caa7d HTTP/1.1" status: 200 len: 217 time: 0.0499179 Nov 24 11:16:30.289068 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e008f6-d01c-4525-a5c8-593d643f953d req-23fc29af-b7f8-4fdc-9b14-417af817b509 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:30.290561 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-23fc29af-b7f8-4fdc-9b14-417af817b509 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=cd868cb4-b7fb-4350-b027-a21baabac768 HTTP/1.1" status: 200 len: 855 time: 0.0445697 Nov 24 11:16:30.322975 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-da539b29-ec32-4073-b8e2-8782304252f7 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=8558262b-7125-4688-a6ea-2f1d2c3b2876&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0238626 Nov 24 11:16:30.431180 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-887214f9-5d7c-4f28-b210-a688775aeeca service neutron] 10.222.0.86 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0964503 Nov 24 11:16:30.474379 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83bacc1d-1a7e-4852-9df2-84caa89eaf0e req-8f411b1f-2b02-457c-8714-31c6715cccce tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:30.476217 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-83bacc1d-1a7e-4852-9df2-84caa89eaf0e req-8f411b1f-2b02-457c-8714-31c6715cccce tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 944 time: 0.0625930 Nov 24 11:16:30.522532 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device bc9cf739-16b6-4224-a3fd-869dd9adb0f4 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:16:30.585173 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-83bacc1d-1a7e-4852-9df2-84caa89eaf0e req-1c70df65-ece3-472b-8854-e021033ef495 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0970063 Nov 24 11:16:30.598659 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-62e008f6-d01c-4525-a5c8-593d643f953d req-8c1fa582-ab8f-49ac-88b3-11920e1a6c1d service neutron] 10.222.0.86 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1468415 Nov 24 11:16:30.666695 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port bc9cf739-16b6-4224-a3fd-869dd9adb0f4, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=bc9cf739-16b6-4224-a3fd-869dd9adb0f4,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:30.680029 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': 'bc9cf739-16b6-4224-a3fd-869dd9adb0f4', 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a', 'port_id': 'bc9cf739-16b6-4224-a3fd-869dd9adb0f4', 'mac_address': 'fa:16:3e:8a:ad:78', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1226, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e89fe7df-9fbd-43c3-9f7a-0597324b938f', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:16:30.719172 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:30.737828 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bc9cf739-16b6-4224-a3fd-869dd9adb0f4 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:16:30.758452 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port bc9cf739-16b6-4224-a3fd-869dd9adb0f4, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=bc9cf739-16b6-4224-a3fd-869dd9adb0f4,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:30.796125 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebede7d6-11b8-44f3-a40f-f572583ceb97 req-5f899fbb-4e30-4e66-b585-c247c07acabf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:30.797581 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ebede7d6-11b8-44f3-a40f-f572583ceb97 req-5f899fbb-4e30-4e66-b585-c247c07acabf service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 1096 time: 0.0544934 Nov 24 11:16:30.814355 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:30.877803 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=bc9cf739-16b6-4224-a3fd-869dd9adb0f4,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:30.903785 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebede7d6-11b8-44f3-a40f-f572583ceb97 req-3318b220-3081-47a7-8d18-f1303b108c69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:30.905332 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ebede7d6-11b8-44f3-a40f-f572583ceb97 req-3318b220-3081-47a7-8d18-f1303b108c69 service neutron] 10.222.0.86 "GET /v2.0/networks?id=8558262b-7125-4688-a6ea-2f1d2c3b2876 HTTP/1.1" status: 200 len: 917 time: 0.0990026 Nov 24 11:16:30.958727 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ebede7d6-11b8-44f3-a40f-f572583ceb97 req-99a03f34-ddc0-48f2-ae09-0c8cb12ba8c0 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=4937438f-b5f9-45ee-9f52-e426878caa7d HTTP/1.1" status: 200 len: 217 time: 0.0405736 Nov 24 11:16:31.014631 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ecc6804-f1f3-41b5-b6d7-e7b98fc01f67 req-a1489a78-425d-4270-8b13-e81e2e066986 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:31.015507 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebede7d6-11b8-44f3-a40f-f572583ceb97 req-61be5d77-b210-4133-a9d9-86ddc9712c04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:31.016207 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5ecc6804-f1f3-41b5-b6d7-e7b98fc01f67 req-a1489a78-425d-4270-8b13-e81e2e066986 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0528400 Nov 24 11:16:31.017237 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ebede7d6-11b8-44f3-a40f-f572583ceb97 req-61be5d77-b210-4133-a9d9-86ddc9712c04 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=cd868cb4-b7fb-4350-b027-a21baabac768 HTTP/1.1" status: 200 len: 855 time: 0.0501330 Nov 24 11:16:31.058642 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ebede7d6-11b8-44f3-a40f-f572583ceb97 req-f472dbbb-dddb-4e62-80ec-42b294850da3 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=8558262b-7125-4688-a6ea-2f1d2c3b2876&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0278018 Nov 24 11:16:31.069239 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5ecc6804-f1f3-41b5-b6d7-e7b98fc01f67 req-e51f5016-46a6-44c3-914e-57f74132b7f3 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445831 Nov 24 11:16:31.139659 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['bc9cf739-16b6-4224-a3fd-869dd9adb0f4'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:16:31.161955 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ebede7d6-11b8-44f3-a40f-f572583ceb97 req-0f58d6d6-47ff-4cc7-83df-77bc95260f3a service neutron] 10.222.0.86 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0948234 Nov 24 11:16:31.497484 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ebede7d6-11b8-44f3-a40f-f572583ceb97 req-8869f16f-58f6-482e-9b0e-ae5ab9169334 service neutron] 10.222.0.86 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3232872 Nov 24 11:16:31.745379 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc52c046-6c06-4bef-ae77-49808a82a886 req-466bf70f-b6bb-4125-b8f9-a27c2e374549 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:31.746975 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fc52c046-6c06-4bef-ae77-49808a82a886 req-466bf70f-b6bb-4125-b8f9-a27c2e374549 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 944 time: 0.0598578 Nov 24 11:16:31.824023 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fc52c046-6c06-4bef-ae77-49808a82a886 req-eba45c58-f249-4754-8fb4-96051031a9f6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707171 Nov 24 11:16:32.186479 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9af0e58-6c0d-45d0-ac37-279981dbc82a req-f4919533-cb08-400c-87a0-b0f16bf77ee0 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:32.187979 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f9af0e58-6c0d-45d0-ac37-279981dbc82a req-f4919533-cb08-400c-87a0-b0f16bf77ee0 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0521884 Nov 24 11:16:32.236461 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f9af0e58-6c0d-45d0-ac37-279981dbc82a req-0df6d978-f964-4929-b2be-3b23b5d5f9d9 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419424 Nov 24 11:16:32.675342 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:16:32.679491 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device bc9cf739-16b6-4224-a3fd-869dd9adb0f4 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:16:32.813922 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=6cf63bf9-c3aa-422b-a4f0-c496f8b73423,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:32.827527 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '6cf63bf9-c3aa-422b-a4f0-c496f8b73423', 'network_id': 'b21f02d2-c533-4fb1-acd2-d2fd73a5180a', 'port_id': '6cf63bf9-c3aa-422b-a4f0-c496f8b73423', 'mac_address': 'fa:16:3e:63:71:df', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1226, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e89fe7df-9fbd-43c3-9f7a-0597324b938f', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:16:32.869414 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port bc9cf739-16b6-4224-a3fd-869dd9adb0f4 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:16:32.881581 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port bc9cf739-16b6-4224-a3fd-869dd9adb0f4 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:16:32.882011 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:32.912797 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:32.936363 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:16:32.963205 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=6cf63bf9-c3aa-422b-a4f0-c496f8b73423,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:32.966965 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38179824-7bc7-4261-a6cc-1df285c3942f req-b10c8ed6-aa4b-4f4e-b3ce-316c0a1bf546 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:32.968825 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-38179824-7bc7-4261-a6cc-1df285c3942f req-b10c8ed6-aa4b-4f4e-b3ce-316c0a1bf546 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 944 time: 0.0567019 Nov 24 11:16:33.011465 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:33.034959 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-38179824-7bc7-4261-a6cc-1df285c3942f req-1dbc53be-1e72-485b-b2e7-488b1fc396f7 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595398 Nov 24 11:16:33.035749 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:33.044981 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a160f50-082e-4f8c-8483-fe7d8b41501e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bc9cf739-16b6-4224-a3fd-869dd9adb0f4'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:16:33.047226 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ed92573-b068-49b0-9b9d-120d58ab4cd8" -d '{"events": [{"server_uuid": "1a160f50-082e-4f8c-8483-fe7d8b41501e", "name": "network-vif-plugged", "status": "completed", "tag": "bc9cf739-16b6-4224-a3fd-869dd9adb0f4"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:16:33.083337 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port bc9cf739-16b6-4224-a3fd-869dd9adb0f4, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=bc9cf739-16b6-4224-a3fd-869dd9adb0f4,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:33.088805 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:16:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-47141b00-58b3-47d2-9eab-01aa7c4df0a8 x-openstack-request-id: req-47141b00-58b3-47d2-9eab-01aa7c4df0a8 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:16:33.089085 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a160f50-082e-4f8c-8483-fe7d8b41501e", "name": "network-vif-plugged", "status": "completed", "tag": "bc9cf739-16b6-4224-a3fd-869dd9adb0f4", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:16:33.089336 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-47141b00-58b3-47d2-9eab-01aa7c4df0a8 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:16:33.089797 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a160f50-082e-4f8c-8483-fe7d8b41501e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bc9cf739-16b6-4224-a3fd-869dd9adb0f4', 'code': 200} Nov 24 11:16:33.106493 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=6cf63bf9-c3aa-422b-a4f0-c496f8b73423,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:33.179577 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:33.180376 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:16:33.217956 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:16:33.218330 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device bbc5a65b-fbc9-4d76-8a9a-8ae13650c1ce not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:16:33.248783 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=bc9cf739-16b6-4224-a3fd-869dd9adb0f4,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:33.378925 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['6cf63bf9-c3aa-422b-a4f0-c496f8b73423'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:16:33.494348 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bfbfe2f-b510-41da-b787-ac11de40390d req-96b3f51a-b86c-4697-844f-2929f24c9f0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:33.496046 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-2bfbfe2f-b510-41da-b787-ac11de40390d req-96b3f51a-b86c-4697-844f-2929f24c9f0c service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 1099 time: 0.0517960 Nov 24 11:16:33.566447 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-2bfbfe2f-b510-41da-b787-ac11de40390d req-a4fbd38a-7ef0-4979-978e-1559cb266d9c service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507283 Nov 24 11:16:33.568156 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26969fb8-34fc-47a8-bf29-3fda28d8c37c req-0e067d6c-6376-4ed1-b35a-cb01df3bc3e6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:33.572562 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-26969fb8-34fc-47a8-bf29-3fda28d8c37c req-0e067d6c-6376-4ed1-b35a-cb01df3bc3e6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.2551644 Nov 24 11:16:33.618136 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-26969fb8-34fc-47a8-bf29-3fda28d8c37c req-67cd52a0-9db2-4938-977e-8a0e5329dee2 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420036 Nov 24 11:16:34.160807 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6d6e844-a8d7-4423-a154-01cd0db785dd req-34c68247-99ac-45f8-84f9-a60889f0aed3 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:34.162322 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e6d6e844-a8d7-4423-a154-01cd0db785dd req-34c68247-99ac-45f8-84f9-a60889f0aed3 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 945 time: 0.0534728 Nov 24 11:16:34.211846 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e6d6e844-a8d7-4423-a154-01cd0db785dd req-2bbe743b-c65e-4146-bea0-b761ac0fce0c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434341 Nov 24 11:16:34.565873 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:16:34.671010 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:16:34.675798 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:16:34.676722 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:34.749007 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3838b9e-9fc0-49ef-b664-5d1d76caf719 req-10925730-72af-41b6-9265-ae2cc4fbe599 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:34.750951 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b3838b9e-9fc0-49ef-b664-5d1d76caf719 req-10925730-72af-41b6-9265-ae2cc4fbe599 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0539060 Nov 24 11:16:34.758351 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:34.794573 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=6cf63bf9-c3aa-422b-a4f0-c496f8b73423,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:34.817806 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b3838b9e-9fc0-49ef-b664-5d1d76caf719 req-003862d5-bc23-4ed1-a5a6-ffcd285434f3 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573816 Nov 24 11:16:34.836525 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:34.883994 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=6cf63bf9-c3aa-422b-a4f0-c496f8b73423,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:35.090781 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9395c84b-5176-4a1b-a13c-dc62c8222c1a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6cf63bf9-c3aa-422b-a4f0-c496f8b73423'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:16:35.093597 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1de59cb5-bc37-45c5-a304-615739fc44a6" -d '{"events": [{"server_uuid": "9395c84b-5176-4a1b-a13c-dc62c8222c1a", "name": "network-vif-plugged", "status": "completed", "tag": "6cf63bf9-c3aa-422b-a4f0-c496f8b73423"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:16:35.131279 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:16:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6064a698-5c6e-4e47-b70d-ec750f7cb6a7 x-openstack-request-id: req-6064a698-5c6e-4e47-b70d-ec750f7cb6a7 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:16:35.131279 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9395c84b-5176-4a1b-a13c-dc62c8222c1a", "name": "network-vif-plugged", "status": "completed", "tag": "6cf63bf9-c3aa-422b-a4f0-c496f8b73423", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:16:35.131279 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-6064a698-5c6e-4e47-b70d-ec750f7cb6a7 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:16:35.131596 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9395c84b-5176-4a1b-a13c-dc62c8222c1a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6cf63bf9-c3aa-422b-a4f0-c496f8b73423', 'code': 200} Nov 24 11:16:35.334143 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c0678a-bc88-4445-b071-5b330ad8840e req-91012509-7009-46b9-8d05-0ca25effb656 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:35.335776 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b8c0678a-bc88-4445-b071-5b330ad8840e req-91012509-7009-46b9-8d05-0ca25effb656 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0520051 Nov 24 11:16:35.383960 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b8c0678a-bc88-4445-b071-5b330ad8840e req-7157e116-150b-4c60-bc9c-2c6c8566bed0 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422029 Nov 24 11:16:35.457235 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a5aace6-bfcb-45e6-b745-e356955e1086 req-75d5ce09-f75f-4fdf-a121-21c4e1eaa668 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:35.458721 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7a5aace6-bfcb-45e6-b745-e356955e1086 req-75d5ce09-f75f-4fdf-a121-21c4e1eaa668 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 1099 time: 0.0418572 Nov 24 11:16:35.511085 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7a5aace6-bfcb-45e6-b745-e356955e1086 req-c0046709-be24-4f1d-9729-452b888e865b service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420115 Nov 24 11:16:35.944102 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0bd7583-d7b0-4cdf-9b16-131ef49686b6 req-86585cc4-9974-4526-858e-777d220b83f8 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:35.945593 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e0bd7583-d7b0-4cdf-9b16-131ef49686b6 req-86585cc4-9974-4526-858e-777d220b83f8 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0553629 Nov 24 11:16:35.996900 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e0bd7583-d7b0-4cdf-9b16-131ef49686b6 req-cdf7a238-9e8e-4f30-85d8-66cdb05bed21 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454223 Nov 24 11:16:36.505005 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb21295-3ebf-477d-9f4b-9caf4757b986 req-436eeb04-a5b8-4003-b887-9153f9e9c0ac tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:36.506479 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1cb21295-3ebf-477d-9f4b-9caf4757b986 req-436eeb04-a5b8-4003-b887-9153f9e9c0ac tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0491514 Nov 24 11:16:36.553217 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1cb21295-3ebf-477d-9f4b-9caf4757b986 req-54ab6757-f6e6-436d-bb98-baa3dc235c24 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409286 Nov 24 11:16:37.114769 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773647d2-f382-403c-8660-037a1e3699e8 req-54178f27-08c6-4b51-a266-7876c914af1c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:37.116410 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-773647d2-f382-403c-8660-037a1e3699e8 req-54178f27-08c6-4b51-a266-7876c914af1c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0488122 Nov 24 11:16:37.165897 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-773647d2-f382-403c-8660-037a1e3699e8 req-55e378d7-7f3a-4190-860c-89ee295f32c2 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436666 Nov 24 11:16:37.679964 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96486b2-b964-4e1d-be73-cbe00b2974cb req-654644ca-49e6-44e2-87f9-a734bfb512b6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:37.681537 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c96486b2-b964-4e1d-be73-cbe00b2974cb req-654644ca-49e6-44e2-87f9-a734bfb512b6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0560811 Nov 24 11:16:37.730889 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c96486b2-b964-4e1d-be73-cbe00b2974cb req-ea5bebe5-b807-4a63-990f-c15974195a9b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433612 Nov 24 11:16:38.285588 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ba7c19-7110-41d3-8605-bee02d5577e0 req-deaf8141-8150-4338-aa1b-7298e3e4dcaa tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:38.287103 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-08ba7c19-7110-41d3-8605-bee02d5577e0 req-deaf8141-8150-4338-aa1b-7298e3e4dcaa tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0504093 Nov 24 11:16:38.348748 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-08ba7c19-7110-41d3-8605-bee02d5577e0 req-fc98d2b6-e164-43a2-ae70-468e6911c1fb tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551984 Nov 24 11:16:38.392368 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eff88553-4712-4828-bdb9-4191468e4d68 req-5a468aa7-7889-4afd-84fd-3d316658e007 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:38.393893 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eff88553-4712-4828-bdb9-4191468e4d68 req-5a468aa7-7889-4afd-84fd-3d316658e007 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0685892 Nov 24 11:16:38.437301 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7f623e-c4c0-4d50-8ae0-494871bb558a req-1f2232fb-495d-4fae-9e87-f2436c92a2b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:38.439538 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-3d7f623e-c4c0-4d50-8ae0-494871bb558a req-1f2232fb-495d-4fae-9e87-f2436c92a2b4 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=30efcb46099b42a3a76be0d52d0d0213&device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 1099 time: 0.0403528 Nov 24 11:16:38.443874 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eff88553-4712-4828-bdb9-4191468e4d68 req-7b7f961f-0304-4fe0-bf58-923653e48e13 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434883 Nov 24 11:16:38.535834 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7f623e-c4c0-4d50-8ae0-494871bb558a req-96f396e1-9b64-442e-b494-ce08579275ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:38.537292 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-3d7f623e-c4c0-4d50-8ae0-494871bb558a req-96f396e1-9b64-442e-b494-ce08579275ee service neutron] 10.222.0.86 "GET /v2.0/networks?id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a HTTP/1.1" status: 200 len: 921 time: 0.0872593 Nov 24 11:16:38.583124 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-3d7f623e-c4c0-4d50-8ae0-494871bb558a req-dc08b246-608e-4abb-8617-ec43252d12d7 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=6cf63bf9-c3aa-422b-a4f0-c496f8b73423 HTTP/1.1" status: 200 len: 217 time: 0.0361326 Nov 24 11:16:38.674118 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7f623e-c4c0-4d50-8ae0-494871bb558a req-faf8c176-4272-4a4a-b8db-e4fcd54b23f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:38.675591 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-3d7f623e-c4c0-4d50-8ae0-494871bb558a req-faf8c176-4272-4a4a-b8db-e4fcd54b23f2 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=e89fe7df-9fbd-43c3-9f7a-0597324b938f HTTP/1.1" status: 200 len: 859 time: 0.0482206 Nov 24 11:16:38.708447 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-3d7f623e-c4c0-4d50-8ae0-494871bb558a req-15e7549a-df9b-43fb-8329-61be0895f708 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0236228 Nov 24 11:16:38.756753 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-052e9332-1259-41d4-8453-7c473dce797a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:38.806032 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-3d7f623e-c4c0-4d50-8ae0-494871bb558a req-96935122-d1d8-48ef-8140-e813ded438f5 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845451 Nov 24 11:16:38.906574 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-3d7f623e-c4c0-4d50-8ae0-494871bb558a req-37cf9836-064f-4e9f-bd8b-0943f0478971 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877974 Nov 24 11:16:39.116398 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:39.475396 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19b86352-1605-4af6-96e9-9254e572af70 req-4a603b5f-3db4-4c56-a7d7-a8db09bfcbf9 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:39.476966 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-19b86352-1605-4af6-96e9-9254e572af70 req-4a603b5f-3db4-4c56-a7d7-a8db09bfcbf9 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0558097 Nov 24 11:16:39.539800 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-19b86352-1605-4af6-96e9-9254e572af70 req-83c0ab58-1c42-4acc-8f56-429c65acb7e1 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552063 Nov 24 11:16:39.578509 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d2e5dcd-d258-47b2-9141-fd4fb3f18778 req-d038117c-aa43-491a-8e1f-654eaf6b43c1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:39.580631 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8d2e5dcd-d258-47b2-9141-fd4fb3f18778 req-d038117c-aa43-491a-8e1f-654eaf6b43c1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0613050 Nov 24 11:16:39.634163 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8d2e5dcd-d258-47b2-9141-fd4fb3f18778 req-4b6708c5-6006-4c53-94fc-29c51ff21fb5 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476651 Nov 24 11:16:40.667948 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d4f9de-0950-427a-b83c-7b9de202f32e req-d22b428c-6891-4fa2-98d2-a7ad426d3966 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:40.669957 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b9d4f9de-0950-427a-b83c-7b9de202f32e req-d22b428c-6891-4fa2-98d2-a7ad426d3966 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0552907 Nov 24 11:16:40.727738 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b9d4f9de-0950-427a-b83c-7b9de202f32e req-d0565284-82ef-44bf-927e-7e9f710e5bd8 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501463 Nov 24 11:16:40.852125 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a698db2-e383-484a-bdc9-10e6174de965 req-51dafc53-85fb-4097-864e-2180b2f8eeb7 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:40.853733 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8a698db2-e383-484a-bdc9-10e6174de965 req-51dafc53-85fb-4097-864e-2180b2f8eeb7 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0599236 Nov 24 11:16:40.907276 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8a698db2-e383-484a-bdc9-10e6174de965 req-a4520f11-162f-484d-a491-2e12b65faf28 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470059 Nov 24 11:16:41.242588 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fba0696b-bec9-4f64-ab56-61a7892a7075 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:41.855369 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81bb10fa-3c4f-4263-92d9-3e459a7c083d req-a71b1d03-68fe-4aac-86b9-90fa4a6ba4ac tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:41.857020 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-81bb10fa-3c4f-4263-92d9-3e459a7c083d req-a71b1d03-68fe-4aac-86b9-90fa4a6ba4ac tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0577660 Nov 24 11:16:41.909333 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-81bb10fa-3c4f-4263-92d9-3e459a7c083d req-d05cf0a8-b55d-4e0e-9782-b2b09a090e3c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451078 Nov 24 11:16:42.183437 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940aac1d-6e0b-4ec3-9948-bfd0a1a0d2b3 req-38e4306c-dc69-48bc-b041-5b28076df598 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:42.184975 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-940aac1d-6e0b-4ec3-9948-bfd0a1a0d2b3 req-38e4306c-dc69-48bc-b041-5b28076df598 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0487783 Nov 24 11:16:42.236411 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-940aac1d-6e0b-4ec3-9948-bfd0a1a0d2b3 req-4f732067-b189-4618-a61d-ca27c19b60c4 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446382 Nov 24 11:16:42.476721 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:43.024683 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04ae2f86-6383-459e-8234-250f6e8ebaac req-3d20bb51-ce6c-4f84-80c2-9e51255c4354 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:43.026180 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-04ae2f86-6383-459e-8234-250f6e8ebaac req-3d20bb51-ce6c-4f84-80c2-9e51255c4354 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0506315 Nov 24 11:16:43.081142 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-04ae2f86-6383-459e-8234-250f6e8ebaac req-7b31fb21-6980-4c0a-875d-9c8773e77f47 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485475 Nov 24 11:16:43.359088 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9266f17e-f18a-4edc-adf3-b7d5d742a6f9 req-3e032d6f-14ab-467a-bba5-2f55315062fb tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:43.360725 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9266f17e-f18a-4edc-adf3-b7d5d742a6f9 req-3e032d6f-14ab-467a-bba5-2f55315062fb tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0518301 Nov 24 11:16:43.408767 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9266f17e-f18a-4edc-adf3-b7d5d742a6f9 req-457d2225-e825-4b5a-bf82-1f57bc19dd58 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419500 Nov 24 11:16:43.492251 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 55886) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:43.598185 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-50d296d9-d435-45b7-a06a-4206b9df096c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:43.670605 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-50d296d9-d435-45b7-a06a-4206b9df096c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:43.739807 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-50d296d9-d435-45b7-a06a-4206b9df096c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:43.778746 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-50d296d9-d435-45b7-a06a-4206b9df096c admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=949e279782d948ae8bbf93154d73463d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2853694 Nov 24 11:16:43.779772 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50d296d9-d435-45b7-a06a-4206b9df096c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e992b53-af77-4d42-9443-e2fc945f3156,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:43.781588 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 55890) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:43.833638 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6fe5a707-01ea-45a9-91c1-3f1f07127f73 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:43.856794 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6fe5a707-01ea-45a9-91c1-3f1f07127f73 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:44.002125 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6fe5a707-01ea-45a9-91c1-3f1f07127f73 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:44.004758 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6fe5a707-01ea-45a9-91c1-3f1f07127f73 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:44.005897 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-6fe5a707-01ea-45a9-91c1-3f1f07127f73 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/5e992b53-af77-4d42-9443-e2fc945f3156 HTTP/1.1" status: 204 len: 168 time: 0.2217646 Nov 24 11:16:44.014377 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fe5a707-01ea-45a9-91c1-3f1f07127f73 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e992b53-af77-4d42-9443-e2fc945f3156,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:44.033812 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:44.228124 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d2ec33a-42ef-40a8-a89e-ebad977330f1 req-da4d53bf-de4e-4ea9-93b5-6d053e5e450b tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:44.230466 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5d2ec33a-42ef-40a8-a89e-ebad977330f1 req-da4d53bf-de4e-4ea9-93b5-6d053e5e450b tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0617268 Nov 24 11:16:44.289396 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5d2ec33a-42ef-40a8-a89e-ebad977330f1 req-2d4a59f6-3e95-4953-80e1-6638b65d1551 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510499 Nov 24 11:16:44.527634 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a50ba68-d16e-41b1-891f-c2207d66b6be req-316637bf-1ec2-4661-a9a2-d3b15e7fee04 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:44.529091 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8a50ba68-d16e-41b1-891f-c2207d66b6be req-316637bf-1ec2-4661-a9a2-d3b15e7fee04 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0494013 Nov 24 11:16:44.578461 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8a50ba68-d16e-41b1-891f-c2207d66b6be req-e28c9c37-7bc5-4b9a-9148-95fc53879987 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432954 Nov 24 11:16:44.613295 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 55914) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:44.626914 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f6159202-477f-45b8-bea3-4fbfe08ca55d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:44.705829 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f6159202-477f-45b8-bea3-4fbfe08ca55d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:44.773478 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f6159202-477f-45b8-bea3-4fbfe08ca55d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:44.802624 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:44.815563 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6159202-477f-45b8-bea3-4fbfe08ca55d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=51cb55ed-5312-40f2-a57a-8648b54a85ea,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:44.819597 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-f6159202-477f-45b8-bea3-4fbfe08ca55d admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=f0c9631a766d40208949b7f4524e3cec&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2052813 Nov 24 11:16:44.822167 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 55916) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:44.870447 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-78233a2a-7178-4261-8af0-372c20c29b04 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:44.893030 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-78233a2a-7178-4261-8af0-372c20c29b04 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:45.013458 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-78233a2a-7178-4261-8af0-372c20c29b04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:45.016782 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-78233a2a-7178-4261-8af0-372c20c29b04 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:45.017999 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-78233a2a-7178-4261-8af0-372c20c29b04 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/51cb55ed-5312-40f2-a57a-8648b54a85ea HTTP/1.1" status: 204 len: 168 time: 0.1949217 Nov 24 11:16:45.025934 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78233a2a-7178-4261-8af0-372c20c29b04 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51cb55ed-5312-40f2-a57a-8648b54a85ea,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:45.427585 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0043f3b6-6f32-4f4d-8cb7-f348076265d2 req-d9c82de1-ca79-4eff-a8ae-54d5629b2d80 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:45.429262 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0043f3b6-6f32-4f4d-8cb7-f348076265d2 req-d9c82de1-ca79-4eff-a8ae-54d5629b2d80 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0583344 Nov 24 11:16:45.525512 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0043f3b6-6f32-4f4d-8cb7-f348076265d2 req-400bacbb-ff09-4060-b108-723125422b37 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0898042 Nov 24 11:16:45.702612 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec6226b-0839-49e5-990d-453a7ebb6860 req-1dd033fa-5fef-410e-a952-919f4300a7b2 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:45.705033 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ec6226b-0839-49e5-990d-453a7ebb6860 req-1dd033fa-5fef-410e-a952-919f4300a7b2 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0509195 Nov 24 11:16:45.760425 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ec6226b-0839-49e5-990d-453a7ebb6860 req-550630a5-39ca-40e8-8366-e74f6250ae05 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0491974 Nov 24 11:16:46.637271 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd5afa53-3c73-4a09-a7aa-0a0e9539ea79 req-c4c9c93f-da6e-458b-b432-3c5b68852889 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:46.638758 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fd5afa53-3c73-4a09-a7aa-0a0e9539ea79 req-c4c9c93f-da6e-458b-b432-3c5b68852889 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0506914 Nov 24 11:16:46.687928 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fd5afa53-3c73-4a09-a7aa-0a0e9539ea79 req-3440ef51-d242-4639-8944-67acf5c5d85b tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428050 Nov 24 11:16:46.881415 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a548384-f126-43c8-ba39-1a53803d78fb req-b184efb3-4891-4d74-9676-4d514c545c03 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:46.883107 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4a548384-f126-43c8-ba39-1a53803d78fb req-b184efb3-4891-4d74-9676-4d514c545c03 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0558684 Nov 24 11:16:46.933871 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4a548384-f126-43c8-ba39-1a53803d78fb req-bdf74f47-9e01-48a9-8b34-0f32e2ef06d9 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442300 Nov 24 11:16:47.814920 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eba20561-fa65-4c50-b350-f3ed10bb56b0 req-d012aeec-ba24-4a44-a6b0-ad97ab670441 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:47.816436 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eba20561-fa65-4c50-b350-f3ed10bb56b0 req-d012aeec-ba24-4a44-a6b0-ad97ab670441 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0515399 Nov 24 11:16:47.866455 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eba20561-fa65-4c50-b350-f3ed10bb56b0 req-fd35ad54-8dae-46df-9093-a61bbaafb21b tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441077 Nov 24 11:16:48.057872 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151ea4fa-3346-4413-9b7c-eb0ff89b211a req-045a5756-f0b5-4914-9c4c-9501d230e8e5 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:48.059409 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-151ea4fa-3346-4413-9b7c-eb0ff89b211a req-045a5756-f0b5-4914-9c4c-9501d230e8e5 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0502841 Nov 24 11:16:48.123385 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-151ea4fa-3346-4413-9b7c-eb0ff89b211a req-4bfc6e0d-9895-40af-a33b-f9716157afdc tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484996 Nov 24 11:16:48.981113 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad0ea4de-66ea-446c-845c-c5b7bcf153a8 req-cdb274af-6383-4ce4-beac-20c28300c818 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:48.982498 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ad0ea4de-66ea-446c-845c-c5b7bcf153a8 req-cdb274af-6383-4ce4-beac-20c28300c818 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0485210 Nov 24 11:16:49.033083 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ad0ea4de-66ea-446c-845c-c5b7bcf153a8 req-a3e19a7b-baa7-4da4-a285-94ae624b32b5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434742 Nov 24 11:16:49.052566 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:16:49.254883 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45963f31-fe4c-48bc-8df4-c0e797b73e1d req-5eda64db-5fa5-481f-9d30-93859bfcd36d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:49.256366 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-45963f31-fe4c-48bc-8df4-c0e797b73e1d req-5eda64db-5fa5-481f-9d30-93859bfcd36d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0499942 Nov 24 11:16:49.333789 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7129b660-3c62-4e60-ae48-a00dc65f8f1b req-ec90dc63-13b8-44b4-86a6-d3a124ad35be tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:49.335276 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7129b660-3c62-4e60-ae48-a00dc65f8f1b req-ec90dc63-13b8-44b4-86a6-d3a124ad35be tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0768297 Nov 24 11:16:49.342905 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-45963f31-fe4c-48bc-8df4-c0e797b73e1d req-16da74c8-5bdd-4eec-b656-85ba276ee905 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0761945 Nov 24 11:16:49.388690 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7129b660-3c62-4e60-ae48-a00dc65f8f1b req-e4211e7e-d529-45d0-9a78-7059d0d88575 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436230 Nov 24 11:16:50.165174 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d34f2cc-bcdb-40a0-b05e-ec509dbe498d req-5419a733-b0d6-4601-b5d5-d481b5b352c7 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:50.166668 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8d34f2cc-bcdb-40a0-b05e-ec509dbe498d req-5419a733-b0d6-4601-b5d5-d481b5b352c7 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0543835 Nov 24 11:16:50.221643 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8d34f2cc-bcdb-40a0-b05e-ec509dbe498d req-5fe0f7f0-c1db-45aa-8fbc-10002ecffa90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489087 Nov 24 11:16:50.481686 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd2cdf5d-65cf-4713-a467-c510da5ca5a3 req-fc24fa87-6f55-4963-ba75-814af0d3e56e tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:50.483164 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd2cdf5d-65cf-4713-a467-c510da5ca5a3 req-fc24fa87-6f55-4963-ba75-814af0d3e56e tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0627131 Nov 24 11:16:50.551723 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d8b2349-2d52-4ae3-aa36-8354a0707f82 req-c50e8709-fd4c-4a96-a249-6f897c56d415 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:50.553313 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0d8b2349-2d52-4ae3-aa36-8354a0707f82 req-c50e8709-fd4c-4a96-a249-6f897c56d415 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0907459 Nov 24 11:16:50.558013 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd2cdf5d-65cf-4713-a467-c510da5ca5a3 req-53a44856-9882-4e26-8e9a-508b001a84bb tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609989 Nov 24 11:16:50.601972 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0d8b2349-2d52-4ae3-aa36-8354a0707f82 req-afed83c6-acde-49c1-afdf-c4c48acdafe6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424767 Nov 24 11:16:51.342663 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a489066-f463-4fee-a28b-4851447b6a59 req-8d36cf45-3f91-4c25-9e71-0d05fdc31b1b tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:51.344143 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3a489066-f463-4fee-a28b-4851447b6a59 req-8d36cf45-3f91-4c25-9e71-0d05fdc31b1b tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0493937 Nov 24 11:16:51.394780 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3a489066-f463-4fee-a28b-4851447b6a59 req-367dc5e2-4573-4c6a-a7be-fd8d97575e53 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439327 Nov 24 11:16:51.680122 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c123849-a58f-447b-ae10-0ecbf593868d req-7b8a3967-c84e-40b4-8075-fdceaddbf13f tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:51.681657 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8c123849-a58f-447b-ae10-0ecbf593868d req-7b8a3967-c84e-40b4-8075-fdceaddbf13f tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0542133 Nov 24 11:16:51.760197 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8c123849-a58f-447b-ae10-0ecbf593868d req-a6011b04-e11b-469b-9e48-fb93615c3bce tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662236 Nov 24 11:16:51.768168 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a362d86c-faca-4947-b97d-79f4cd62f450 req-b93af963-479a-4f52-93da-c61ee0992dae tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:51.770016 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a362d86c-faca-4947-b97d-79f4cd62f450 req-b93af963-479a-4f52-93da-c61ee0992dae tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0874693 Nov 24 11:16:51.833472 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a362d86c-faca-4947-b97d-79f4cd62f450 req-31d7b964-ea17-4717-a55c-50ff8bc1c73f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511293 Nov 24 11:16:52.518743 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9dcdfe5-02c0-4f1f-8cf6-99ec9ef9e0ac req-791aa604-ef99-46d9-99dc-49ed971bc350 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:52.520318 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c9dcdfe5-02c0-4f1f-8cf6-99ec9ef9e0ac req-791aa604-ef99-46d9-99dc-49ed971bc350 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0576317 Nov 24 11:16:52.569192 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c9dcdfe5-02c0-4f1f-8cf6-99ec9ef9e0ac req-2169910d-052e-4d7b-911d-6b6b357da3d6 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427821 Nov 24 11:16:52.901008 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-673f2d9c-a25c-43ed-b739-3cec24b24674 req-fc8cece9-1084-4b9c-b782-c7178d6ec1f3 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:52.902453 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-673f2d9c-a25c-43ed-b739-3cec24b24674 req-fc8cece9-1084-4b9c-b782-c7178d6ec1f3 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0539889 Nov 24 11:16:52.981744 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-673f2d9c-a25c-43ed-b739-3cec24b24674 req-1aff21b0-301d-4a97-ae31-10b71b21ebb9 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731974 Nov 24 11:16:53.004668 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dafc3296-611a-46a6-a4fa-5fa04f44b8c5 req-cb0821e4-ed79-453c-91f0-321c203a8812 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:53.006242 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dafc3296-611a-46a6-a4fa-5fa04f44b8c5 req-cb0821e4-ed79-453c-91f0-321c203a8812 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0839968 Nov 24 11:16:53.058748 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dafc3296-611a-46a6-a4fa-5fa04f44b8c5 req-fbf48125-490e-4dbf-b8e5-4b7c3b352613 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461571 Nov 24 11:16:53.687317 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7f1580e-423a-4fc0-9b43-0a1106205d5f req-5eec0860-b693-4374-8380-dae50327f198 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:53.688805 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e7f1580e-423a-4fc0-9b43-0a1106205d5f req-5eec0860-b693-4374-8380-dae50327f198 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0495574 Nov 24 11:16:53.735314 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e7f1580e-423a-4fc0-9b43-0a1106205d5f req-15078e51-11b8-4be4-b920-32cb43455d10 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405750 Nov 24 11:16:54.113495 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43c933aa-bdde-4c1f-b8f2-d0895a52a6e5 req-e41abb32-d12a-4dfe-b454-5f23558e64f1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:54.115435 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-43c933aa-bdde-4c1f-b8f2-d0895a52a6e5 req-e41abb32-d12a-4dfe-b454-5f23558e64f1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0610631 Nov 24 11:16:54.193212 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-43c933aa-bdde-4c1f-b8f2-d0895a52a6e5 req-686d461c-8099-48c0-81fd-c5372e6d902c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0716770 Nov 24 11:16:54.211883 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61a75606-b20e-4936-acaf-68dd0584d684 req-87de9f29-f427-4945-b01d-0a487917792d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:54.213386 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-61a75606-b20e-4936-acaf-68dd0584d684 req-87de9f29-f427-4945-b01d-0a487917792d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0694642 Nov 24 11:16:54.269126 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-61a75606-b20e-4936-acaf-68dd0584d684 req-864bef59-fb20-4126-ad4f-a7ca52ab1571 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476878 Nov 24 11:16:54.329595 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 56396) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:54.472257 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-9cfbee7c-baca-43ef-a0c7-4ecd58a52cef admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=b898b9cc37224c3ab1f1d21b45ad66eb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1415095 Nov 24 11:16:54.474720 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 56404) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:54.520575 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-adbe5c36-ac54-477b-8d84-c6b1a84e93b9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:54.541282 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-adbe5c36-ac54-477b-8d84-c6b1a84e93b9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:54.659154 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-adbe5c36-ac54-477b-8d84-c6b1a84e93b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:54.661787 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-adbe5c36-ac54-477b-8d84-c6b1a84e93b9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:54.662970 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-adbe5c36-ac54-477b-8d84-c6b1a84e93b9 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/480ab1d3-b975-419a-89c0-5a2ddd41c025 HTTP/1.1" status: 204 len: 168 time: 0.1873682 Nov 24 11:16:54.671530 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adbe5c36-ac54-477b-8d84-c6b1a84e93b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=480ab1d3-b975-419a-89c0-5a2ddd41c025,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:54.691091 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 4937438f-b5f9-45ee-9f52-e426878caa7d details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:16:54.792371 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 4937438f-b5f9-45ee-9f52-e426878caa7d, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4937438f-b5f9-45ee-9f52-e426878caa7d,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:54.804964 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '4937438f-b5f9-45ee-9f52-e426878caa7d', 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876', 'port_id': '4937438f-b5f9-45ee-9f52-e426878caa7d', 'mac_address': 'fa:16:3e:78:b7:e4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1227, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cd868cb4-b7fb-4350-b027-a21baabac768', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:16:54.842369 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:54.855251 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4937438f-b5f9-45ee-9f52-e426878caa7d {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:16:54.859517 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb105d3f-4c18-4387-a340-54ab16522da2 req-a1b3a830-1c59-4188-a2e4-186d154866ef tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:54.861024 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fb105d3f-4c18-4387-a340-54ab16522da2 req-a1b3a830-1c59-4188-a2e4-186d154866ef tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 943 time: 0.0544312 Nov 24 11:16:54.875736 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 4937438f-b5f9-45ee-9f52-e426878caa7d, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4937438f-b5f9-45ee-9f52-e426878caa7d,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:54.915858 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fb105d3f-4c18-4387-a340-54ab16522da2 req-b30fe7e0-fd96-4782-93eb-77e48a050544 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474484 Nov 24 11:16:54.944554 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:55.000369 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=4937438f-b5f9-45ee-9f52-e426878caa7d,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:55.287488 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['4937438f-b5f9-45ee-9f52-e426878caa7d'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:16:55.310129 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db1324e5-a7ca-4d15-b458-497592d2b04e req-979ca172-2788-4164-8da4-29a3c2617c19 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:55.312785 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-db1324e5-a7ca-4d15-b458-497592d2b04e req-979ca172-2788-4164-8da4-29a3c2617c19 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0500650 Nov 24 11:16:55.369240 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-db1324e5-a7ca-4d15-b458-497592d2b04e req-7dfd0a05-2487-49cf-9210-05560c3b6b24 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508730 Nov 24 11:16:55.407962 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6af51759-1910-4613-ae39-377f70d6fe28 req-f27940f1-e109-4f81-a246-4f6ff35c589d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:55.409975 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6af51759-1910-4613-ae39-377f70d6fe28 req-f27940f1-e109-4f81-a246-4f6ff35c589d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0608118 Nov 24 11:16:55.465055 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6af51759-1910-4613-ae39-377f70d6fe28 req-c92dcd63-3124-4948-b6bb-10c386674ac8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483596 Nov 24 11:16:56.046426 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f655496-5bc4-46cf-a0c2-d34e2d34c94a req-7f427e77-d927-4604-baf0-d79849599e2d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:56.047827 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5f655496-5bc4-46cf-a0c2-d34e2d34c94a req-7f427e77-d927-4604-baf0-d79849599e2d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 944 time: 0.0486701 Nov 24 11:16:56.095804 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5f655496-5bc4-46cf-a0c2-d34e2d34c94a req-b9d59731-d41b-42f4-a5a2-3a1ac1c24afd tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416915 Nov 24 11:16:56.482400 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd881cde-aaab-4832-91a0-a2f1bc5c1569 req-f4084037-182e-4b5e-9309-e8ad9c0480a0 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:56.483901 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd881cde-aaab-4832-91a0-a2f1bc5c1569 req-f4084037-182e-4b5e-9309-e8ad9c0480a0 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0474954 Nov 24 11:16:56.539373 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd881cde-aaab-4832-91a0-a2f1bc5c1569 req-9a90b31a-7da5-4162-9f38-4c393da6af93 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488684 Nov 24 11:16:56.586636 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35043074-94cd-4ea3-9692-b8ce1e12717d req-ecd17c98-de05-4954-9962-d4044b6f843e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:56.588120 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-35043074-94cd-4ea3-9692-b8ce1e12717d req-ecd17c98-de05-4954-9962-d4044b6f843e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0479040 Nov 24 11:16:56.634885 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-35043074-94cd-4ea3-9692-b8ce1e12717d req-eae38f78-9e4a-47a4-8534-b9f36704d55e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409729 Nov 24 11:16:56.708939 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 4937438f-b5f9-45ee-9f52-e426878caa7d up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:16:56.847883 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 4937438f-b5f9-45ee-9f52-e426878caa7d completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:16:56.851892 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 4937438f-b5f9-45ee-9f52-e426878caa7d triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:16:56.852259 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:56.934053 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:56.959405 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1b563a6c-0dc5-4560-941a-74894bab54c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4937438f-b5f9-45ee-9f52-e426878caa7d'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:16:56.961662 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ffc9890d-1b6a-4703-b1af-ebb11e9c3d32" -d '{"events": [{"server_uuid": "1b563a6c-0dc5-4560-941a-74894bab54c5", "name": "network-vif-plugged", "status": "completed", "tag": "4937438f-b5f9-45ee-9f52-e426878caa7d"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:16:56.975008 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 4937438f-b5f9-45ee-9f52-e426878caa7d, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4937438f-b5f9-45ee-9f52-e426878caa7d,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:16:57.011326 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:16:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b8e84470-89f8-41e9-98ca-cb5924f08f79 x-openstack-request-id: req-b8e84470-89f8-41e9-98ca-cb5924f08f79 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:16:57.011627 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1b563a6c-0dc5-4560-941a-74894bab54c5", "name": "network-vif-plugged", "status": "completed", "tag": "4937438f-b5f9-45ee-9f52-e426878caa7d", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:16:57.011886 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-b8e84470-89f8-41e9-98ca-cb5924f08f79 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:16:57.012279 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1b563a6c-0dc5-4560-941a-74894bab54c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4937438f-b5f9-45ee-9f52-e426878caa7d', 'code': 200} Nov 24 11:16:57.042790 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:57.105580 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=4937438f-b5f9-45ee-9f52-e426878caa7d,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:57.131494 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 56452) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:57.214073 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e80dba-ff6a-472c-a0fe-4904beae8ba0 req-bea7a717-17d2-4fe9-8de4-860be60faa91 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:57.215586 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-18e80dba-ff6a-472c-a0fe-4904beae8ba0 req-bea7a717-17d2-4fe9-8de4-860be60faa91 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 945 time: 0.0503101 Nov 24 11:16:57.246338 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:57.288876 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-18e80dba-ff6a-472c-a0fe-4904beae8ba0 req-70412304-b58d-4956-b278-bfc8194dd18c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674856 Nov 24 11:16:57.345457 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:57.359473 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a9cd78-662f-4aa8-ae35-74296d40864f req-a7b8ebc9-a281-4d15-99d1-a20f8f50258c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:57.360968 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-93a9cd78-662f-4aa8-ae35-74296d40864f req-a7b8ebc9-a281-4d15-99d1-a20f8f50258c service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 1098 time: 0.0436041 Nov 24 11:16:57.407108 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-93a9cd78-662f-4aa8-ae35-74296d40864f req-2182ebe6-6127-4815-987f-6db23cb4739a service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360410 Nov 24 11:16:57.453131 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:57.491897 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=83a85d826ec54453a47b21e440f2b321&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3593142 Nov 24 11:16:57.492705 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bf9bb5e1-18cb-4b47-b66e-b3158d7b6d5d,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:57.494630 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 56456) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:16:57.499935 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:57.500351 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:57.500613 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:57.500943 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:57.501262 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:57.501586 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:57.501902 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:57.502220 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:57.502533 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:57.502851 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:57.503163 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:57.503564 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dee86e7d-24d1-48c0-8c26-4302782cb6a6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:16:57.542259 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-516ce139-45e0-4f8a-a98c-db208899198b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:57.564131 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-516ce139-45e0-4f8a-a98c-db208899198b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:57.654493 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0dd1d14-38a9-4c96-8d46-31b2b699c9a9 req-b1729a77-9290-46d3-adbd-686f44be0405 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:57.655971 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c0dd1d14-38a9-4c96-8d46-31b2b699c9a9 req-b1729a77-9290-46d3-adbd-686f44be0405 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0480831 Nov 24 11:16:57.693308 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-516ce139-45e0-4f8a-a98c-db208899198b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:57.696218 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-516ce139-45e0-4f8a-a98c-db208899198b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:16:57.697377 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-516ce139-45e0-4f8a-a98c-db208899198b admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/bf9bb5e1-18cb-4b47-b66e-b3158d7b6d5d HTTP/1.1" status: 204 len: 168 time: 0.2016947 Nov 24 11:16:57.708248 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-516ce139-45e0-4f8a-a98c-db208899198b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bf9bb5e1-18cb-4b47-b66e-b3158d7b6d5d,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:16:57.709594 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c0dd1d14-38a9-4c96-8d46-31b2b699c9a9 req-0a7a90ac-7a14-4132-beea-8f5646a7cde3 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468180 Nov 24 11:16:57.765037 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b440673-9758-42a3-827d-489fb3f30764 req-b7d6dec2-e21d-4133-940e-5245900a3cf0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:57.766508 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5b440673-9758-42a3-827d-489fb3f30764 req-b7d6dec2-e21d-4133-940e-5245900a3cf0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0496809 Nov 24 11:16:57.818354 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5b440673-9758-42a3-827d-489fb3f30764 req-f2f80e5b-1f67-4d81-af33-78bb167cf7ee tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451167 Nov 24 11:16:58.403956 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df498e10-81f6-4777-af2b-41263f788a0c req-31e6e9d3-117e-445d-8e1b-bb29b87990cf tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:58.405394 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-df498e10-81f6-4777-af2b-41263f788a0c req-31e6e9d3-117e-445d-8e1b-bb29b87990cf tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 945 time: 0.0488017 Nov 24 11:16:58.452938 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-df498e10-81f6-4777-af2b-41263f788a0c req-99574801-f49f-4c44-854c-8e22e424959f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414078 Nov 24 11:16:58.832894 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d9f8800-942b-46d9-8013-779a863c482b req-afdf95ca-8a66-46c4-80fb-27f51e82a03a tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:58.835331 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0d9f8800-942b-46d9-8013-779a863c482b req-afdf95ca-8a66-46c4-80fb-27f51e82a03a tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0510128 Nov 24 11:16:58.906344 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0d9f8800-942b-46d9-8013-779a863c482b req-3f10063a-215a-47f8-9845-2370078b2582 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652456 Nov 24 11:16:58.965949 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a04bfe4-236a-474e-922f-7a92d7a6a242 req-8603fc49-6a99-457c-9257-bcdeb857a94f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:58.967425 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4a04bfe4-236a-474e-922f-7a92d7a6a242 req-8603fc49-6a99-457c-9257-bcdeb857a94f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0590322 Nov 24 11:16:59.016465 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4a04bfe4-236a-474e-922f-7a92d7a6a242 req-4e25429e-f73c-457d-ad3d-5903b165577f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419090 Nov 24 11:16:59.573940 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8749ed10-135a-4f4d-a33c-67019eddd086 req-66f728bb-70c2-42b7-8739-8156e82bacad tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:16:59.575448 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8749ed10-135a-4f4d-a33c-67019eddd086 req-66f728bb-70c2-42b7-8739-8156e82bacad tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 945 time: 0.0513391 Nov 24 11:16:59.624532 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8749ed10-135a-4f4d-a33c-67019eddd086 req-f61cd39c-5a09-48d6-8354-e46a08c2043f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415857 Nov 24 11:17:00.021688 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a16e179e-538b-4d11-b0ee-79fad06f67e9 req-ef1fd3b6-b17b-4e74-bfd7-cd55dea34753 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:00.023193 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a16e179e-538b-4d11-b0ee-79fad06f67e9 req-ef1fd3b6-b17b-4e74-bfd7-cd55dea34753 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0488307 Nov 24 11:17:00.084501 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a16e179e-538b-4d11-b0ee-79fad06f67e9 req-38af78c8-2d2e-4843-8f68-1b8a1328cb3b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511773 Nov 24 11:17:00.214029 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb5c0b4f-f7ee-4f3d-8935-978dd27fba6f req-de14332f-e28f-47cd-9389-3534dde474af tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:00.215544 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bb5c0b4f-f7ee-4f3d-8935-978dd27fba6f req-de14332f-e28f-47cd-9389-3534dde474af tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0707946 Nov 24 11:17:00.228157 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789af1ee-6596-446d-b0c0-af121aa60768 req-5d64bfca-77f3-4754-ac37-230860f76fb1 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:00.229430 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-789af1ee-6596-446d-b0c0-af121aa60768 req-5d64bfca-77f3-4754-ac37-230860f76fb1 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0941331 Nov 24 11:17:00.328058 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bb5c0b4f-f7ee-4f3d-8935-978dd27fba6f req-3f44f367-a5c7-4eaf-ab0f-966e789fe649 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0976374 Nov 24 11:17:00.333163 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-789af1ee-6596-446d-b0c0-af121aa60768 req-db492323-151d-4db0-8d92-2ff2b8d1b7bb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0888858 Nov 24 11:17:01.198281 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b8043a-c384-4410-9c0a-7251186c3be4 req-f698926d-819c-4130-bf9a-e48f0f1f4c79 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:01.199828 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b7b8043a-c384-4410-9c0a-7251186c3be4 req-f698926d-819c-4130-bf9a-e48f0f1f4c79 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0513158 Nov 24 11:17:01.247753 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b7b8043a-c384-4410-9c0a-7251186c3be4 req-3ef3dbe0-836b-4922-9d0a-e5cd316e9c30 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413699 Nov 24 11:17:01.488892 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad38b51c-e7bd-4d84-92b1-fa8ef4070f4a req-6aa72623-6a8b-43a9-993e-af6cf6d070b9 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:01.490337 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ad38b51c-e7bd-4d84-92b1-fa8ef4070f4a req-6aa72623-6a8b-43a9-993e-af6cf6d070b9 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0858355 Nov 24 11:17:01.523390 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97e8d80b-bdfc-46b8-8a11-5f0d225d2578 req-ea807063-6e5b-49d9-a0ed-82cd35dd667a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:01.524784 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-97e8d80b-bdfc-46b8-8a11-5f0d225d2578 req-ea807063-6e5b-49d9-a0ed-82cd35dd667a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0789094 Nov 24 11:17:01.564421 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ad38b51c-e7bd-4d84-92b1-fa8ef4070f4a req-e03aa4fa-dad1-49df-80b7-c8329ac73f38 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0676749 Nov 24 11:17:01.597820 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-97e8d80b-bdfc-46b8-8a11-5f0d225d2578 req-09ac68bf-e9fe-4611-9307-0df7e682870e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0622344 Nov 24 11:17:02.366393 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89791a7b-04cf-4cdf-ab48-db6a1567010a req-25d99041-556b-473b-ac67-06e6a1deb4a3 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:02.367896 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-89791a7b-04cf-4cdf-ab48-db6a1567010a req-25d99041-556b-473b-ac67-06e6a1deb4a3 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0504138 Nov 24 11:17:02.428100 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-89791a7b-04cf-4cdf-ab48-db6a1567010a req-cfbba414-da9a-4c1e-b970-7a88c2075171 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537221 Nov 24 11:17:02.733202 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ff8a1fd-2568-4582-93fa-497a6b50d53a req-36deb7ef-6725-4373-b85a-aeb7dd9ac75b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:02.733202 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7ff8a1fd-2568-4582-93fa-497a6b50d53a req-36deb7ef-6725-4373-b85a-aeb7dd9ac75b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0929275 Nov 24 11:17:02.757628 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c24feb7-cb4e-41f5-aee8-5d76147a7dc4 req-9e1db080-d861-4606-a6d5-57ad63aa3dd0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:02.759275 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5c24feb7-cb4e-41f5-aee8-5d76147a7dc4 req-9e1db080-d861-4606-a6d5-57ad63aa3dd0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0762618 Nov 24 11:17:02.829476 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7ff8a1fd-2568-4582-93fa-497a6b50d53a req-194e8a70-0cf2-4a14-a49e-b2122a8ac098 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0870278 Nov 24 11:17:02.836758 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5c24feb7-cb4e-41f5-aee8-5d76147a7dc4 req-a369f94a-461e-4717-aaf1-a48bf5003b7d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0697427 Nov 24 11:17:03.545541 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee5aaaa8-d264-469a-b17b-62b11aaad808 req-300c446d-e6c2-4237-841f-678ae2c20773 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:03.547021 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ee5aaaa8-d264-469a-b17b-62b11aaad808 req-300c446d-e6c2-4237-841f-678ae2c20773 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0488307 Nov 24 11:17:03.594912 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ee5aaaa8-d264-469a-b17b-62b11aaad808 req-8b251405-c2f2-4621-b4f9-093dd6589476 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418758 Nov 24 11:17:03.980145 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48e8eab1-69e1-428f-976c-21f75bd45eff req-18290e4e-4aeb-4ab0-90b2-3e1c61098539 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:03.981726 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-48e8eab1-69e1-428f-976c-21f75bd45eff req-18290e4e-4aeb-4ab0-90b2-3e1c61098539 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0821235 Nov 24 11:17:03.994409 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-581602b9-7141-4f80-aecc-a1ebd0c83e11 req-fa2d69f0-0417-41a5-bcd7-49c1fd70f822 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:03.995866 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-581602b9-7141-4f80-aecc-a1ebd0c83e11 req-fa2d69f0-0417-41a5-bcd7-49c1fd70f822 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0665426 Nov 24 11:17:04.067558 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-48e8eab1-69e1-428f-976c-21f75bd45eff req-876d844f-9d39-48e5-a23f-cb3e66e3477a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0700862 Nov 24 11:17:04.075285 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-581602b9-7141-4f80-aecc-a1ebd0c83e11 req-b3208f53-28db-4e46-8662-d4a61e8778aa tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0718873 Nov 24 11:17:04.712694 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef6b7f7-e3a9-4705-8fde-e84b08f7ad17 req-01668696-949e-4626-b472-ed82f349338e tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:04.714254 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ef6b7f7-e3a9-4705-8fde-e84b08f7ad17 req-01668696-949e-4626-b472-ed82f349338e tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0508695 Nov 24 11:17:04.774567 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ef6b7f7-e3a9-4705-8fde-e84b08f7ad17 req-44d9e79d-5cae-481c-85c1-53aceced5231 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544939 Nov 24 11:17:05.219765 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-714c3fe5-e879-4263-ac50-046f6f6a365f req-65b77493-860a-4b8c-b4be-d154d4f810aa tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:05.221229 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-714c3fe5-e879-4263-ac50-046f6f6a365f req-65b77493-860a-4b8c-b4be-d154d4f810aa tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0811481 Nov 24 11:17:05.233423 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cad77296-81b4-4cfc-bda5-c47420c14587 req-8ff1dbe5-88a4-4981-9a56-80ac5e63f7b7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:05.234837 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cad77296-81b4-4cfc-bda5-c47420c14587 req-8ff1dbe5-88a4-4981-9a56-80ac5e63f7b7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0636637 Nov 24 11:17:05.304122 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-714c3fe5-e879-4263-ac50-046f6f6a365f req-b8c170b0-eb97-40c5-8b75-5834e6d3c05f tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0683203 Nov 24 11:17:05.311097 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cad77296-81b4-4cfc-bda5-c47420c14587 req-a00efcaa-0d2e-43ca-81ba-075b7af63a2c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0696633 Nov 24 11:17:05.893627 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc1bdb1-b37f-4072-ab1d-910eeabb53f5 req-93a25ad4-0157-40a0-bed5-1de31408c384 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:05.895054 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3dc1bdb1-b37f-4072-ab1d-910eeabb53f5 req-93a25ad4-0157-40a0-bed5-1de31408c384 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0521147 Nov 24 11:17:05.939942 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3dc1bdb1-b37f-4072-ab1d-910eeabb53f5 req-b2baba1c-886c-4ace-b917-894a2e058e7d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388999 Nov 24 11:17:06.448928 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b31513b6-1073-4f9a-9a2c-4c7b934e443d req-a6dfdb3c-cf41-4962-954d-4cfb12a20938 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:06.450407 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b31513b6-1073-4f9a-9a2c-4c7b934e443d req-a6dfdb3c-cf41-4962-954d-4cfb12a20938 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0783970 Nov 24 11:17:06.459351 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c475c525-105a-4ddc-b776-fc4f7ce0b660 req-85eb96bf-3e80-41c3-a0e4-4253b5fdf92f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:06.460808 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c475c525-105a-4ddc-b776-fc4f7ce0b660 req-85eb96bf-3e80-41c3-a0e4-4253b5fdf92f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0776641 Nov 24 11:17:06.539717 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b31513b6-1073-4f9a-9a2c-4c7b934e443d req-cf3758ad-9779-4bde-b4ea-c63d2978e43d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0778675 Nov 24 11:17:06.543151 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c475c525-105a-4ddc-b776-fc4f7ce0b660 req-5d76f954-d45e-415d-af5a-2cf93f80e840 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0757253 Nov 24 11:17:07.053498 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af81b346-6f9b-48f3-8a66-3cb983549ef8 req-3c2541af-d50e-4b89-bbce-3bfe88c017ed tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:07.054247 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-af81b346-6f9b-48f3-8a66-3cb983549ef8 req-3c2541af-d50e-4b89-bbce-3bfe88c017ed tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0478270 Nov 24 11:17:07.104202 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-af81b346-6f9b-48f3-8a66-3cb983549ef8 req-9a162b96-ac21-41b4-addc-cf8168d03560 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440831 Nov 24 11:17:07.683576 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2891119-710e-4461-a67f-db1c47d0a40d req-4c625be7-520f-40f6-ad98-f08b2983572f tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:07.685044 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f2891119-710e-4461-a67f-db1c47d0a40d req-4c625be7-520f-40f6-ad98-f08b2983572f tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0757253 Nov 24 11:17:07.697349 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a63566f8-ef46-43d9-b5ec-0f6a436648d1 req-37400279-f56d-4300-9c91-24f897786663 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:07.698782 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a63566f8-ef46-43d9-b5ec-0f6a436648d1 req-37400279-f56d-4300-9c91-24f897786663 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0800474 Nov 24 11:17:07.765439 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f2891119-710e-4461-a67f-db1c47d0a40d req-e61267bc-b706-40f4-87d4-6363587636ed tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0656109 Nov 24 11:17:07.772669 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a63566f8-ef46-43d9-b5ec-0f6a436648d1 req-8848e6ba-6b54-474c-8719-00d9960a100d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0671871 Nov 24 11:17:08.221993 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-158532dd-c765-4044-ba61-cf00b6168b8b req-2bf384d8-458c-4602-8cfd-382d5ed6bef1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:08.223736 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-158532dd-c765-4044-ba61-cf00b6168b8b req-2bf384d8-458c-4602-8cfd-382d5ed6bef1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0504036 Nov 24 11:17:08.272489 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-158532dd-c765-4044-ba61-cf00b6168b8b req-8d0de564-21e3-45db-93d1-2bb38de8a195 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421290 Nov 24 11:17:08.733311 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d1ca99db-ee2d-4a16-a205-888421b25abe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:08.912322 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d29be80e-9eca-4b15-b36c-c0b756e251a1 req-2915b444-da72-4de6-9989-e3fb1652fc4c service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0414767 Nov 24 11:17:08.933563 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c936b839-efb9-4b76-b70e-b548c42076ae req-7435fa15-e56c-437f-8474-fddaf109ca7c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:08.935089 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c936b839-efb9-4b76-b70e-b548c42076ae req-7435fa15-e56c-437f-8474-fddaf109ca7c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0888407 Nov 24 11:17:08.948218 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-545afad8-9c57-4919-ac98-277f3a3a4df4 req-3e2905fb-1438-4ce3-89d0-e573e3521932 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:08.949597 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-545afad8-9c57-4919-ac98-277f3a3a4df4 req-3e2905fb-1438-4ce3-89d0-e573e3521932 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0676622 Nov 24 11:17:08.994911 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d29be80e-9eca-4b15-b36c-c0b756e251a1 req-703fe1ec-529e-4643-a361-f6bbd8b943a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:08.996574 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d29be80e-9eca-4b15-b36c-c0b756e251a1 req-703fe1ec-529e-4643-a361-f6bbd8b943a3 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 1098 time: 0.0512567 Nov 24 11:17:09.032710 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c936b839-efb9-4b76-b70e-b548c42076ae req-afc60ea3-7a74-4988-92d9-e19a30573df9 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0821595 Nov 24 11:17:09.037711 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-545afad8-9c57-4919-ac98-277f3a3a4df4 req-f7ca4662-a89b-473e-bc35-445a5baa8dc8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0732396 Nov 24 11:17:09.110171 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d29be80e-9eca-4b15-b36c-c0b756e251a1 req-8112ee0a-794f-48af-873f-d01ed1ec2469 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:09.111684 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d29be80e-9eca-4b15-b36c-c0b756e251a1 req-8112ee0a-794f-48af-873f-d01ed1ec2469 service neutron] 10.222.0.86 "GET /v2.0/networks?id=8558262b-7125-4688-a6ea-2f1d2c3b2876 HTTP/1.1" status: 200 len: 917 time: 0.0893459 Nov 24 11:17:09.157616 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d29be80e-9eca-4b15-b36c-c0b756e251a1 req-f50388ad-600f-493d-a3f4-df9dd0c75c42 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=af19a68f-fbb1-4d8c-9034-627d69f6dfd0 HTTP/1.1" status: 200 len: 217 time: 0.0376379 Nov 24 11:17:09.172852 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:09.214754 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d29be80e-9eca-4b15-b36c-c0b756e251a1 req-009f8324-b3e9-435a-b68c-4179dd53480e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:09.216246 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d29be80e-9eca-4b15-b36c-c0b756e251a1 req-009f8324-b3e9-435a-b68c-4179dd53480e service neutron] 10.222.0.86 "GET /v2.0/subnets?id=cd868cb4-b7fb-4350-b027-a21baabac768 HTTP/1.1" status: 200 len: 855 time: 0.0448689 Nov 24 11:17:09.248114 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d29be80e-9eca-4b15-b36c-c0b756e251a1 req-17c786e1-e8b7-4c15-936e-f5d6a20dde6a service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=8558262b-7125-4688-a6ea-2f1d2c3b2876&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0238292 Nov 24 11:17:09.341852 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d29be80e-9eca-4b15-b36c-c0b756e251a1 req-1bd49914-6b0f-4c78-8aff-080f3cc90c3e service neutron] 10.222.0.86 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0850220 Nov 24 11:17:09.395767 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78f88bbb-8fb4-4d4c-bcf7-ce68bdb1d9f1 req-4cf21ec6-d03a-443f-b426-926d2bf9e5f8 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:09.397406 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-78f88bbb-8fb4-4d4c-bcf7-ce68bdb1d9f1 req-4cf21ec6-d03a-443f-b426-926d2bf9e5f8 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0512342 Nov 24 11:17:09.439048 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d29be80e-9eca-4b15-b36c-c0b756e251a1 req-f3cf81d6-f4c3-4f20-9d7a-e205d9100b6c service neutron] 10.222.0.86 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886400 Nov 24 11:17:09.448839 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-78f88bbb-8fb4-4d4c-bcf7-ce68bdb1d9f1 req-21260ea4-5481-4e90-8f09-733075698211 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450208 Nov 24 11:17:10.190121 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f340c649-465a-4f98-a077-a2dc90baf56f req-2c6ee56f-6ea5-45fb-a9f9-79d54e076fee tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:10.191611 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f340c649-465a-4f98-a077-a2dc90baf56f req-2c6ee56f-6ea5-45fb-a9f9-79d54e076fee tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0701225 Nov 24 11:17:10.199760 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-566e3b99-d832-4385-bf38-764df3d36deb req-7141672c-4388-4cc2-958c-d3e31210a8c1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:10.201198 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-566e3b99-d832-4385-bf38-764df3d36deb req-7141672c-4388-4cc2-958c-d3e31210a8c1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0888000 Nov 24 11:17:10.273862 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 56778) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:10.276840 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f340c649-465a-4f98-a077-a2dc90baf56f req-ebaa5058-267a-4b25-8326-45a979f80225 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0744510 Nov 24 11:17:10.281564 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-566e3b99-d832-4385-bf38-764df3d36deb req-6e213ac9-35d6-4ee5-bac3-34fd7dc304d7 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0717077 Nov 24 11:17:10.381137 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:10.463051 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:10.516127 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:10.560477 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=cd48c5abcfba4450973b3e119c60d556&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2852249 Nov 24 11:17:10.561788 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fef329cd-7a18-432d-857a-c808755fb69a,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:10.563895 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 56786) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:10.570236 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7084e885-e2c8-4979-9bbf-45ca5e33ca8d req-293c494a-fa5d-442c-9ccf-8ac871cc8608 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:10.571753 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7084e885-e2c8-4979-9bbf-45ca5e33ca8d req-293c494a-fa5d-442c-9ccf-8ac871cc8608 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0525112 Nov 24 11:17:10.579284 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:10.579656 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:10.579996 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:10.580331 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:10.580690 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:10.581022 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:10.581350 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:10.581675 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:10.581998 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:10.582318 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:10.582637 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:10.582955 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6a20e69b-e840-4c71-ba3c-84bfd825fac2 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:10.623424 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7084e885-e2c8-4979-9bbf-45ca5e33ca8d req-d87e54d5-e6a8-4812-a8f7-dea4462cab65 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453570 Nov 24 11:17:10.624623 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-de8231e6-79c3-4ddb-912b-687f0e83b261 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:10.646845 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-de8231e6-79c3-4ddb-912b-687f0e83b261 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:10.744078 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-de8231e6-79c3-4ddb-912b-687f0e83b261 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:10.746741 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-de8231e6-79c3-4ddb-912b-687f0e83b261 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:10.747965 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-de8231e6-79c3-4ddb-912b-687f0e83b261 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/fef329cd-7a18-432d-857a-c808755fb69a HTTP/1.1" status: 204 len: 168 time: 0.1831837 Nov 24 11:17:10.756158 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de8231e6-79c3-4ddb-912b-687f0e83b261 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fef329cd-7a18-432d-857a-c808755fb69a,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:11.172827 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-7892c113-7b9d-476c-8b52-140ac6fbf3b6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:11.434838 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a1aa357-e5f2-42d7-a80c-4f45c33accde req-53e93808-f3cf-427e-9239-106abb4864bb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:11.436411 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6a1aa357-e5f2-42d7-a80c-4f45c33accde req-53e93808-f3cf-427e-9239-106abb4864bb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0811830 Nov 24 11:17:11.445683 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-583f6183-653f-416f-a6d3-f7adda417806 req-bfdae79e-db39-453b-b171-7b77ef95cf1b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:11.447047 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-583f6183-653f-416f-a6d3-f7adda417806 req-bfdae79e-db39-453b-b171-7b77ef95cf1b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0796828 Nov 24 11:17:11.733152 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6a1aa357-e5f2-42d7-a80c-4f45c33accde req-c92054ca-ce13-4ce1-b092-ffdcfce384fa tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2851312 Nov 24 11:17:11.736386 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-583f6183-653f-416f-a6d3-f7adda417806 req-969c0999-3bcb-476e-8d3b-d8fabc0edbe8 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2822902 Nov 24 11:17:11.855655 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a454730-dae7-4912-a766-cc333ea5cf9d req-179f3e86-d524-4229-80e4-d6acc85fb04b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:11.857162 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0a454730-dae7-4912-a766-cc333ea5cf9d req-179f3e86-d524-4229-80e4-d6acc85fb04b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0505250 Nov 24 11:17:11.910718 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0a454730-dae7-4912-a766-cc333ea5cf9d req-2e1d7802-7fe9-49b3-8fec-70c8ccd5641b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476489 Nov 24 11:17:11.989791 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 56836) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:12.097162 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a4e9ad1f-0c26-4a26-8243-49ff2916a746 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:12.175835 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a4e9ad1f-0c26-4a26-8243-49ff2916a746 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:12.258495 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a4e9ad1f-0c26-4a26-8243-49ff2916a746 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:12.299373 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-a4e9ad1f-0c26-4a26-8243-49ff2916a746 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=be1e130062044826afb64e9710c39f40&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3085089 Nov 24 11:17:12.300198 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4e9ad1f-0c26-4a26-8243-49ff2916a746 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79f8fa2c-19dc-4e42-9b02-68cd1eb1a324,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:12.302325 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 56848) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:12.351887 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-05a93654-8314-4d89-b65c-c3ef81b7ce3a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:12.374077 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-05a93654-8314-4d89-b65c-c3ef81b7ce3a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:12.429601 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:12.510049 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-05a93654-8314-4d89-b65c-c3ef81b7ce3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:12.512844 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-05a93654-8314-4d89-b65c-c3ef81b7ce3a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:12.514011 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-05a93654-8314-4d89-b65c-c3ef81b7ce3a admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/79f8fa2c-19dc-4e42-9b02-68cd1eb1a324 HTTP/1.1" status: 204 len: 168 time: 0.2105324 Nov 24 11:17:12.523328 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05a93654-8314-4d89-b65c-c3ef81b7ce3a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79f8fa2c-19dc-4e42-9b02-68cd1eb1a324,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:12.911217 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8560328d-8e52-454d-ad74-83b21faf952d req-b3d8155e-2fe8-4803-b086-14b5d2862c62 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:12.912961 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8560328d-8e52-454d-ad74-83b21faf952d req-b3d8155e-2fe8-4803-b086-14b5d2862c62 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0766273 Nov 24 11:17:12.923374 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742d267e-9187-476b-b5b1-eb5559059156 req-9ca86f93-fbcd-4277-9acc-7d38035a6acd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:12.924800 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-742d267e-9187-476b-b5b1-eb5559059156 req-9ca86f93-fbcd-4277-9acc-7d38035a6acd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0866880 Nov 24 11:17:12.997808 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8560328d-8e52-454d-ad74-83b21faf952d req-dec21622-72e3-4ddb-9dad-ea6b0c62cfed tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0720603 Nov 24 11:17:13.005104 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-742d267e-9187-476b-b5b1-eb5559059156 req-c37da32c-437b-4f04-b0da-966ce14545cf tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0727854 Nov 24 11:17:13.123487 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ceaadc1-bed0-46da-965b-34368959a7aa req-74a33858-a045-4e97-8b8b-7669c442db82 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:13.124950 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ceaadc1-bed0-46da-965b-34368959a7aa req-74a33858-a045-4e97-8b8b-7669c442db82 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0496838 Nov 24 11:17:13.148213 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 56866) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:13.161154 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-18ddbe4d-5109-426c-8fa0-1c048707c2c8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:13.172951 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ceaadc1-bed0-46da-965b-34368959a7aa req-f132e5bb-ca14-49f7-8615-c8f4ba7335af tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420430 Nov 24 11:17:13.238681 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-18ddbe4d-5109-426c-8fa0-1c048707c2c8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:13.418742 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-18ddbe4d-5109-426c-8fa0-1c048707c2c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:13.460926 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-18ddbe4d-5109-426c-8fa0-1c048707c2c8 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=de80aeda9aa94ca58f96b6907b65b6a4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3082919 Nov 24 11:17:13.460926 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18ddbe4d-5109-426c-8fa0-1c048707c2c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=efe56d76-217d-4f5b-a6cc-33b69c5db33e,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:13.461741 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 56872) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:13.511099 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7778b27d-8790-4484-83e2-f892ab1c459b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:13.532664 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7778b27d-8790-4484-83e2-f892ab1c459b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:13.744584 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7778b27d-8790-4484-83e2-f892ab1c459b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:13.747079 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7778b27d-8790-4484-83e2-f892ab1c459b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:13.748249 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-7778b27d-8790-4484-83e2-f892ab1c459b admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/efe56d76-217d-4f5b-a6cc-33b69c5db33e HTTP/1.1" status: 204 len: 168 time: 0.2862957 Nov 24 11:17:13.756316 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7778b27d-8790-4484-83e2-f892ab1c459b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=efe56d76-217d-4f5b-a6cc-33b69c5db33e,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:14.036301 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.079654 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 56892) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:14.224457 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c5ea322-f52f-47c5-beb1-5bbd1244e687 req-d84ad887-a1ce-44f6-a756-565f9fbd0809 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:14.225922 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4c5ea322-f52f-47c5-beb1-5bbd1244e687 req-d84ad887-a1ce-44f6-a756-565f9fbd0809 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.1051285 Nov 24 11:17:14.227469 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ef596c8a-3712-4bbe-be07-4055123811b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.236122 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8e3101b-090a-49a9-a52d-0d65c22f1b0a req-9a3c63e1-78b7-4ef7-994b-11fa81c1aec6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:14.237484 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d8e3101b-090a-49a9-a52d-0d65c22f1b0a req-9a3c63e1-78b7-4ef7-994b-11fa81c1aec6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.1043401 Nov 24 11:17:14.341229 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4c5ea322-f52f-47c5-beb1-5bbd1244e687 req-7b7e62ef-bd8f-4b09-9dc2-876cd72b3a7d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1028039 Nov 24 11:17:14.352527 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d8e3101b-090a-49a9-a52d-0d65c22f1b0a req-f885438d-895d-462d-b8ca-711f8dbef497 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1023467 Nov 24 11:17:14.404041 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ef596c8a-3712-4bbe-be07-4055123811b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.464861 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9416c1b4-6502-4d74-8a79-40d2b3fa6602 req-1c3fe89f-c282-4a5b-b715-abe8b2757a1f tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:14.466505 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9416c1b4-6502-4d74-8a79-40d2b3fa6602 req-1c3fe89f-c282-4a5b-b715-abe8b2757a1f tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0497882 Nov 24 11:17:14.480116 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ef596c8a-3712-4bbe-be07-4055123811b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.480380 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 56900) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:14.497004 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-751b6b2e-e0a6-4c34-bc2c-ae21cc79b7d1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.548708 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-ef596c8a-3712-4bbe-be07-4055123811b3 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=aec7b107a88748e9acffc744ca230d2e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4679503 Nov 24 11:17:14.551534 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 56904) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:14.559661 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef596c8a-3712-4bbe-be07-4055123811b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6cfd147c-0a5b-4a6f-8a37-65b7835822c4,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:14.578545 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9416c1b4-6502-4d74-8a79-40d2b3fa6602 req-d816b3fc-f328-47d0-8e5f-20b6e2c6ed8b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1046722 Nov 24 11:17:14.646083 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6553bce9-7cee-4be2-adde-14ab1faebbfc admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.649626 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-751b6b2e-e0a6-4c34-bc2c-ae21cc79b7d1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.670325 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6553bce9-7cee-4be2-adde-14ab1faebbfc admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.710047 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-751b6b2e-e0a6-4c34-bc2c-ae21cc79b7d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.754342 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-751b6b2e-e0a6-4c34-bc2c-ae21cc79b7d1 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=8d2587fdc1e84a239ff91e1835689e1c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2727499 Nov 24 11:17:14.755850 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-751b6b2e-e0a6-4c34-bc2c-ae21cc79b7d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c8a431a-2e98-42f6-9f85-ad113909ec4d,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:14.757600 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 56908) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:14.778521 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:17:14.795871 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6553bce9-7cee-4be2-adde-14ab1faebbfc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.798739 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6553bce9-7cee-4be2-adde-14ab1faebbfc admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.800139 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-6553bce9-7cee-4be2-adde-14ab1faebbfc admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/6cfd147c-0a5b-4a6f-8a37-65b7835822c4 HTTP/1.1" status: 204 len: 168 time: 0.2456551 Nov 24 11:17:14.811325 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6553bce9-7cee-4be2-adde-14ab1faebbfc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6cfd147c-0a5b-4a6f-8a37-65b7835822c4,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:14.817430 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ce97c6d8-19a5-4e3c-aef2-40f6ce27bce0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.834092 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.843231 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ce97c6d8-19a5-4e3c-aef2-40f6ce27bce0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.898005 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:14.906393 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'port_id': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'mac_address': 'fa:16:3e:ec:fd:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1229, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:17:14.952578 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.961662 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ce97c6d8-19a5-4e3c-aef2-40f6ce27bce0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.964467 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ce97c6d8-19a5-4e3c-aef2-40f6ce27bce0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:14.965613 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-ce97c6d8-19a5-4e3c-aef2-40f6ce27bce0 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/1c8a431a-2e98-42f6-9f85-ad113909ec4d HTTP/1.1" status: 204 len: 168 time: 0.2070487 Nov 24 11:17:14.966583 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:17:14.974866 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce97c6d8-19a5-4e3c-aef2-40f6ce27bce0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c8a431a-2e98-42f6-9f85-ad113909ec4d,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:14.991357 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:15.081199 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:15.130943 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,revision_number=6']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:15.138672 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:15.139042 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:15.139414 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:15.139747 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:15.140069 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:15.140594 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:15.140924 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:15.141422 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:15.141934 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:15.142319 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:15.142669 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:15.143094 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:15.305882 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['ebbec69a-2982-4fe3-b07d-5326d6b7f5f3'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:17:15.518475 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3093b9e2-c6f9-4891-ba27-fd95699c8e95 req-42abb45c-bc70-4ca7-953d-8b72da30765d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:15.519971 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3093b9e2-c6f9-4891-ba27-fd95699c8e95 req-42abb45c-bc70-4ca7-953d-8b72da30765d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0781801 Nov 24 11:17:15.531069 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c1d7407-3b37-4fad-bf36-6831461a6910 req-b5c699de-7a17-4365-973c-d24c1800b677 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:15.532496 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2c1d7407-3b37-4fad-bf36-6831461a6910 req-b5c699de-7a17-4365-973c-d24c1800b677 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.0787308 Nov 24 11:17:15.602697 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3093b9e2-c6f9-4891-ba27-fd95699c8e95 req-cab2c082-1995-4d43-98e7-0a7a6a108c2d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0692177 Nov 24 11:17:15.610678 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2c1d7407-3b37-4fad-bf36-6831461a6910 req-d0329de7-747f-4868-b13e-61f4910c0fe8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0708957 Nov 24 11:17:15.872606 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f945c8dc-32ba-4a32-8267-8ac40ab57b68 req-d3e962a2-f9e0-48fb-9888-1a8dfceb2d49 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:15.874067 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f945c8dc-32ba-4a32-8267-8ac40ab57b68 req-d3e962a2-f9e0-48fb-9888-1a8dfceb2d49 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0573423 Nov 24 11:17:15.922238 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f945c8dc-32ba-4a32-8267-8ac40ab57b68 req-a39aaea6-347f-4ed8-ad75-bed8f8b80039 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419738 Nov 24 11:17:16.790839 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:17:16.808133 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7457ad6f-4a51-4c93-9fbe-ed4a0868dd79 req-eeee068c-4d07-4618-bb71-2bc1effff888 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:16.819495 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7457ad6f-4a51-4c93-9fbe-ed4a0868dd79 req-eeee068c-4d07-4618-bb71-2bc1effff888 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.1029081 Nov 24 11:17:16.844820 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:16.845287 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:16.869664 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc7c1745-817a-40c0-a4cf-054f106f45fc req-37a12ae2-f707-40c1-a7a4-07f0d3d5259e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:16.871496 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bc7c1745-817a-40c0-a4cf-054f106f45fc req-37a12ae2-f707-40c1-a7a4-07f0d3d5259e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.1219203 Nov 24 11:17:16.924948 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7457ad6f-4a51-4c93-9fbe-ed4a0868dd79 req-a5c880d6-a7ca-4919-ba57-0f287e630881 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1038399 Nov 24 11:17:16.966218 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:17.005200 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bc7c1745-817a-40c0-a4cf-054f106f45fc req-335b69d8-c9e7-4bad-94d9-cccebe506189 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1069322 Nov 24 11:17:17.007166 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:17:17.009482 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d4b1e411-4600-40a4-9691-767b64747055" -d '{"events": [{"server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "name": "network-vif-plugged", "status": "completed", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:17:17.028804 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:17.088668 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:17:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-44302f67-2be7-413a-9827-486388a1529b x-openstack-request-id: req-44302f67-2be7-413a-9827-486388a1529b {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:17:17.089002 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "name": "network-vif-plugged", "status": "completed", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:17:17.089262 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-44302f67-2be7-413a-9827-486388a1529b {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:17:17.089651 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'code': 200} Nov 24 11:17:17.107130 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1743ffc-8f3c-4230-a5ca-c7142cfdd3a6 req-8cc5cbe9-6ad7-4457-97a1-13a6e794d240 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:17.108711 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c1743ffc-8f3c-4230-a5ca-c7142cfdd3a6 req-8cc5cbe9-6ad7-4457-97a1-13a6e794d240 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0638626 Nov 24 11:17:17.110057 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:17.174340 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,revision_number=7']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:17.183404 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c1743ffc-8f3c-4230-a5ca-c7142cfdd3a6 req-174d6c76-11f9-4701-8322-eb461d7923f7 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589118 Nov 24 11:17:18.112098 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-133826b7-4204-473d-96db-2ce4ecfc0849 req-c09c22e9-f49a-43fb-94f2-f2bf18d96d37 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:18.115459 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-133826b7-4204-473d-96db-2ce4ecfc0849 req-c09c22e9-f49a-43fb-94f2-f2bf18d96d37 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0929823 Nov 24 11:17:18.211078 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09fd92a2-0693-4bd6-afd7-82ab01409e7c req-2633e3f3-7d7a-4173-94d9-8b002aa75391 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:18.228187 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-09fd92a2-0693-4bd6-afd7-82ab01409e7c req-2633e3f3-7d7a-4173-94d9-8b002aa75391 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0974724 Nov 24 11:17:18.228187 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-133826b7-4204-473d-96db-2ce4ecfc0849 req-a5a20a3c-a5a5-4935-9c52-5352ebb9ceb4 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1060224 Nov 24 11:17:18.283577 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-09fd92a2-0693-4bd6-afd7-82ab01409e7c req-0662641b-45fd-4e43-88fe-e436042e4f8b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0645070 Nov 24 11:17:18.379521 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24692d4c-1e96-4603-9023-4ab0ed9d22ac req-32a62a1e-5bda-49ef-b591-240c5b359312 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:18.381881 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-24692d4c-1e96-4603-9023-4ab0ed9d22ac req-32a62a1e-5bda-49ef-b591-240c5b359312 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0636311 Nov 24 11:17:18.452058 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-24692d4c-1e96-4603-9023-4ab0ed9d22ac req-13782149-9933-401d-a774-016d51cdba96 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632799 Nov 24 11:17:19.363266 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6963b4e5-521e-4c0a-be8f-62f917759f22 req-fa1881c9-6de7-473f-8a0c-1eae80a78fa1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:19.367082 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6963b4e5-521e-4c0a-be8f-62f917759f22 req-fa1881c9-6de7-473f-8a0c-1eae80a78fa1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0585084 Nov 24 11:17:19.446695 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f88285-a5b3-4e1e-a9dd-3772b0a5a55a req-296df644-1fb4-4d07-bfe7-912840764e3f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:19.448223 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d6f88285-a5b3-4e1e-a9dd-3772b0a5a55a req-296df644-1fb4-4d07-bfe7-912840764e3f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0784719 Nov 24 11:17:19.451742 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6963b4e5-521e-4c0a-be8f-62f917759f22 req-f6e07981-c6cc-4ec7-865f-46ae6e90c71f tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0725939 Nov 24 11:17:19.515665 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d6f88285-a5b3-4e1e-a9dd-3772b0a5a55a req-5b158a3e-51e9-4222-996a-582fb6861c6d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0569079 Nov 24 11:17:19.584216 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73992c82-f628-45b4-8f67-4cf4969ebc49 req-30e1a220-1fce-4339-8e03-efaa3f44a559 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:19.585733 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-73992c82-f628-45b4-8f67-4cf4969ebc49 req-30e1a220-1fce-4339-8e03-efaa3f44a559 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0541613 Nov 24 11:17:19.643974 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-73992c82-f628-45b4-8f67-4cf4969ebc49 req-5f21f3ca-8a5b-4b25-96db-070276208f80 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516973 Nov 24 11:17:20.593818 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ac8e879-7e55-4adf-b093-c392a64d5bea req-3c223c86-130d-4fb5-8c78-0f2d833814ee tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:20.605170 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7ac8e879-7e55-4adf-b093-c392a64d5bea req-3c223c86-130d-4fb5-8c78-0f2d833814ee tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0658531 Nov 24 11:17:20.683968 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7ac8e879-7e55-4adf-b093-c392a64d5bea req-134ff71d-e8aa-40e4-92bc-6909f689b74c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0774186 Nov 24 11:17:20.722088 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a96af798-bfcc-4d6c-a8e9-a9ec212f4e1d req-0a9ec8e6-32b1-4497-bd4f-11fd190c8837 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:20.723585 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a96af798-bfcc-4d6c-a8e9-a9ec212f4e1d req-0a9ec8e6-32b1-4497-bd4f-11fd190c8837 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0902147 Nov 24 11:17:20.788221 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a96af798-bfcc-4d6c-a8e9-a9ec212f4e1d req-ed2d2ab6-bafd-4684-8023-527c25e821f0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571070 Nov 24 11:17:20.844107 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87224981-5a51-45d5-8769-830899b9d21c req-55af4c7a-33af-442f-90a0-5b322f54e989 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:20.846052 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-87224981-5a51-45d5-8769-830899b9d21c req-55af4c7a-33af-442f-90a0-5b322f54e989 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0552359 Nov 24 11:17:20.907983 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-87224981-5a51-45d5-8769-830899b9d21c req-9b7b829d-0f50-4dda-9546-308428c361eb tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548606 Nov 24 11:17:21.832538 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-570aac2f-62ec-4702-a267-abe6b08b98a7 req-4e55ac69-0c24-48ac-ba8d-9ff92de1df7d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:21.841503 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-570aac2f-62ec-4702-a267-abe6b08b98a7 req-4e55ac69-0c24-48ac-ba8d-9ff92de1df7d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0713210 Nov 24 11:17:21.904252 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-570aac2f-62ec-4702-a267-abe6b08b98a7 req-b190c610-a99b-40e2-9416-757cbda08e73 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0618646 Nov 24 11:17:21.949837 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b0f483c-600a-4288-9bec-c74465cc9f8d req-a0a08384-23cb-4762-8e3a-6e5dd22899dc tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:21.952133 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4b0f483c-600a-4288-9bec-c74465cc9f8d req-a0a08384-23cb-4762-8e3a-6e5dd22899dc tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0625522 Nov 24 11:17:22.017244 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4b0f483c-600a-4288-9bec-c74465cc9f8d req-7271046d-1bbc-4e1c-be71-cce23cb29174 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0512273 Nov 24 11:17:22.150017 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-442e04ae-e667-4182-9ee7-decee5660c4d req-6afbf400-cbdb-494c-85fd-ef162ec49345 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:22.152036 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-442e04ae-e667-4182-9ee7-decee5660c4d req-6afbf400-cbdb-494c-85fd-ef162ec49345 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0572190 Nov 24 11:17:22.266199 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-442e04ae-e667-4182-9ee7-decee5660c4d req-fe4d1415-af2e-4b99-97ad-d4c82d2ded5a tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982261 Nov 24 11:17:22.302992 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9b4d6d2-e8fb-4ac8-9fdf-6d28f2b39f51 req-c5d78c96-553a-48c2-871c-15fc576ce334 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:22.304883 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e9b4d6d2-e8fb-4ac8-9fdf-6d28f2b39f51 req-c5d78c96-553a-48c2-871c-15fc576ce334 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0973487 Nov 24 11:17:22.383968 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e9b4d6d2-e8fb-4ac8-9fdf-6d28f2b39f51 req-68656aef-0ba8-44a4-8bd0-1d345237bfc0 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0729561 Nov 24 11:17:22.432118 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-542c083b-7ff0-4e10-a018-b5b98eb468d3 req-7cdd64ff-5a5f-4f7d-b74c-c90d4ae56bc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:22.436288 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-542c083b-7ff0-4e10-a018-b5b98eb468d3 req-7cdd64ff-5a5f-4f7d-b74c-c90d4ae56bc5 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=907128185ff9473381be53050d202838&device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 1098 time: 0.0621600 Nov 24 11:17:22.765981 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-542c083b-7ff0-4e10-a018-b5b98eb468d3 req-67969bbb-6cee-4668-a232-f318cddece18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:22.765981 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-542c083b-7ff0-4e10-a018-b5b98eb468d3 req-67969bbb-6cee-4668-a232-f318cddece18 service neutron] 10.222.0.86 "GET /v2.0/networks?id=d9d87ca8-7863-48a6-937c-ee712996776e HTTP/1.1" status: 200 len: 913 time: 0.1060550 Nov 24 11:17:22.765981 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-542c083b-7ff0-4e10-a018-b5b98eb468d3 req-dd9ecd6c-6b8b-4258-90bb-e481844ee68e service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa HTTP/1.1" status: 200 len: 1001 time: 0.0645831 Nov 24 11:17:22.765981 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-542c083b-7ff0-4e10-a018-b5b98eb468d3 req-f4f151c2-c5df-4d9c-9799-1179184fc85c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:22.765981 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-542c083b-7ff0-4e10-a018-b5b98eb468d3 req-f4f151c2-c5df-4d9c-9799-1179184fc85c service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c0d420cf-0b8e-4f90-a25c-9a74e1eafabb HTTP/1.1" status: 200 len: 850 time: 0.0461822 Nov 24 11:17:22.765981 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-542c083b-7ff0-4e10-a018-b5b98eb468d3 req-48cefd70-4d91-4f30-a9e4-f83f0e2296ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:22.765981 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-542c083b-7ff0-4e10-a018-b5b98eb468d3 req-48cefd70-4d91-4f30-a9e4-f83f0e2296ff service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=d9d87ca8-7863-48a6-937c-ee712996776e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0403824 Nov 24 11:17:22.883092 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-542c083b-7ff0-4e10-a018-b5b98eb468d3 req-57e716ca-10ac-405f-abfe-dc78cf06ba50 service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1359627 Nov 24 11:17:22.981635 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-542c083b-7ff0-4e10-a018-b5b98eb468d3 req-f78a122f-8803-4f5a-a951-dd793b61610b service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0878804 Nov 24 11:17:23.149928 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c34b15a5-bbe0-4e56-b78c-560467ca620f req-c95391ca-deab-4edc-8e2d-1772a429ad35 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:23.162613 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c34b15a5-bbe0-4e56-b78c-560467ca620f req-c95391ca-deab-4edc-8e2d-1772a429ad35 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0485988 Nov 24 11:17:23.197726 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c34b15a5-bbe0-4e56-b78c-560467ca620f req-2dc189b5-8b38-456f-bd23-caccdc76bdf4 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403366 Nov 24 11:17:23.378159 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d40a1167-7996-4848-b0b4-b281f65364dc req-50ca094b-4253-4a5e-b46c-edcae64523f2 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:23.379650 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d40a1167-7996-4848-b0b4-b281f65364dc req-50ca094b-4253-4a5e-b46c-edcae64523f2 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0489283 Nov 24 11:17:23.435584 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d40a1167-7996-4848-b0b4-b281f65364dc req-ecb1039b-c6a9-49c8-b249-012734f6a579 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427341 Nov 24 11:17:23.518373 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f242b1-659c-4eb9-a84c-1b4a08751d7f req-312f7bc5-b7a4-4da9-b114-7c1ba562b388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:23.520290 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e8f242b1-659c-4eb9-a84c-1b4a08751d7f req-312f7bc5-b7a4-4da9-b114-7c1ba562b388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0627193 Nov 24 11:17:23.601245 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e8f242b1-659c-4eb9-a84c-1b4a08751d7f req-ae05308d-be93-414c-af6a-198ebe5c47ff tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0734100 Nov 24 11:17:23.857212 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d4e7576-149a-4ce9-8a4c-07cfbdbe07db req-f541e542-7ee0-421b-9930-59816b07ccfb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:23.859092 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-8d4e7576-149a-4ce9-8a4c-07cfbdbe07db req-f541e542-7ee0-421b-9930-59816b07ccfb service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 1099 time: 0.0508418 Nov 24 11:17:23.921966 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-8d4e7576-149a-4ce9-8a4c-07cfbdbe07db req-9548874e-be25-4ab9-bbb3-7b01839fbab0 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0514653 Nov 24 11:17:24.160324 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7975bb75-960b-4d5e-b179-24b21946206d req-8133c4d8-f018-4de7-94ad-e81749a4a79a tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:24.162961 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-8133c4d8-f018-4de7-94ad-e81749a4a79a tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/networks?id=8558262b-7125-4688-a6ea-2f1d2c3b2876 HTTP/1.1" status: 200 len: 815 time: 0.1224902 Nov 24 11:17:24.182715 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-7e71282b-9c67-4676-a4b6-7db4f7dc562d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/quotas/fae8312f669b48b797904792401edfa4 HTTP/1.1" status: 200 len: 375 time: 0.0107281 Nov 24 11:17:24.260909 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-4750ead1-8d6e-4b11-9241-4e78b4778f89 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0693846 Nov 24 11:17:24.387717 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1d2b1e3-4984-45ce-8c16-3efbc871d934 req-b9a06784-33eb-4f9a-ac99-cfc0c0a5fb02 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:24.389288 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b1d2b1e3-4984-45ce-8c16-3efbc871d934 req-b9a06784-33eb-4f9a-ac99-cfc0c0a5fb02 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0999575 Nov 24 11:17:24.391634 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-e30e588e-c71b-4673-8dc1-ecd8345826ca service neutron] 10.222.0.76 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1297922 Nov 24 11:17:24.495430 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b1d2b1e3-4984-45ce-8c16-3efbc871d934 req-4e46906d-194c-4d1e-a616-969018fa8a57 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0992329 Nov 24 11:17:24.536462 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d4279d4-6992-40b7-914c-736d1f5da814 service neutron] 10.222.0.76 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1344059 Nov 24 11:17:24.652583 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-210e6eeb-19b7-4050-a769-78999b4f3b91 req-1d6bc2e2-3feb-4c1c-aef5-116a0ed93043 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:24.661137 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-210e6eeb-19b7-4050-a769-78999b4f3b91 req-1d6bc2e2-3feb-4c1c-aef5-116a0ed93043 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0747936 Nov 24 11:17:24.713686 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-210e6eeb-19b7-4050-a769-78999b4f3b91 req-3e9d1017-9174-4c6f-a88d-2258e735406e tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511360 Nov 24 11:17:24.838990 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-95105b56-71c7-4942-a5c1-97f60620344c req-f5e7a7af-e2c6-4309-9788-928588724b7e tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 210 time: 0.0288522 Nov 24 11:17:24.913085 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef48c9d8-e360-4f50-ba8a-3be18baea485 req-1452ab74-6ac6-4f6e-93b2-9b207fd50fd2 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:24.915466 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ef48c9d8-e360-4f50-ba8a-3be18baea485 req-1452ab74-6ac6-4f6e-93b2-9b207fd50fd2 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0785344 Nov 24 11:17:24.995375 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ef48c9d8-e360-4f50-ba8a-3be18baea485 req-5df12e1c-2bfe-43df-81d4-34a569ce4699 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0735798 Nov 24 11:17:25.285345 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 57152) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:25.402800 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4118a058-fb25-4db3-8fcf-d92a29c48007 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:25.503898 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4118a058-fb25-4db3-8fcf-d92a29c48007 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:25.567194 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4118a058-fb25-4db3-8fcf-d92a29c48007 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:25.633564 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4118a058-fb25-4db3-8fcf-d92a29c48007 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=497e2568-e9db-4f28-a4d4-0e8abd9712d4,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:25.641863 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-4118a058-fb25-4db3-8fcf-d92a29c48007 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=7b9f0d4a43e848329e664f1db045cb12&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3554380 Nov 24 11:17:25.644488 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 57160) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:25.692064 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0fe8ddb-6f3f-4db8-abb6-afafded4c9bb req-2d882ca0-fe70-4fb7-990f-0f38430c0619 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:25.700582 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c0fe8ddb-6f3f-4db8-abb6-afafded4c9bb req-2d882ca0-fe70-4fb7-990f-0f38430c0619 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.1131337 Nov 24 11:17:25.712285 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7f140025-84ee-4780-9f16-4b4bc28f708f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:25.757883 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c0fe8ddb-6f3f-4db8-abb6-afafded4c9bb req-c637ed40-8487-42c4-8aa2-db864b21def9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0562649 Nov 24 11:17:25.767903 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7f140025-84ee-4780-9f16-4b4bc28f708f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:25.872777 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a8317d1-714e-4c54-b46e-710748ac3b15 req-6c602b2c-1ffd-40e3-97e2-2223d58819a3 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:25.874496 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1a8317d1-714e-4c54-b46e-710748ac3b15 req-6c602b2c-1ffd-40e3-97e2-2223d58819a3 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0593879 Nov 24 11:17:25.910306 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7f140025-84ee-4780-9f16-4b4bc28f708f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:25.916780 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7f140025-84ee-4780-9f16-4b4bc28f708f admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:25.919643 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-7f140025-84ee-4780-9f16-4b4bc28f708f admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/497e2568-e9db-4f28-a4d4-0e8abd9712d4 HTTP/1.1" status: 204 len: 168 time: 0.2739933 Nov 24 11:17:25.940702 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f140025-84ee-4780-9f16-4b4bc28f708f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=497e2568-e9db-4f28-a4d4-0e8abd9712d4,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:26.021149 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-85cb25af-a5ba-4fbc-9860-018890e4e8c6 req-ac286a65-c976-4d34-b398-6312e3f79ff7 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 210 time: 0.0786288 Nov 24 11:17:26.051900 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1a8317d1-714e-4c54-b46e-710748ac3b15 req-cd951d6e-7a1a-412b-9337-9ef0427d30b4 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1634769 Nov 24 11:17:26.052525 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:17:26.189852 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-032b095f-33c9-44dc-aeb1-70feea930745 req-2f3b4554-a6d0-4666-b761-f5f446a46530 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:26.192139 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-032b095f-33c9-44dc-aeb1-70feea930745 req-2f3b4554-a6d0-4666-b761-f5f446a46530 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0622706 Nov 24 11:17:26.246610 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-032b095f-33c9-44dc-aeb1-70feea930745 req-92b12cdb-5427-47c3-8d9b-feaba38711bb tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467472 Nov 24 11:17:26.892926 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5954eb5f-c4c6-447d-bd7e-561c4643236b req-a7a3f207-4cd1-4d76-80fd-56624e71f89f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:26.895131 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5954eb5f-c4c6-447d-bd7e-561c4643236b req-a7a3f207-4cd1-4d76-80fd-56624e71f89f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0519602 Nov 24 11:17:26.950044 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5954eb5f-c4c6-447d-bd7e-561c4643236b req-c2ec87ec-f785-4b4b-925e-b8021f09889b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478151 Nov 24 11:17:27.116448 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-db6d348c-21d7-4153-9e16-c96331cc747c req-eb8352bd-dcca-4287-a2be-4b8827bf5e9d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 210 time: 0.0497682 Nov 24 11:17:27.803363 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7975bb75-960b-4d5e-b179-24b21946206d req-9309d7bf-2d21-41ea-8a1a-90d58cd8dfbd tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:27.806085 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-9309d7bf-2d21-41ea-8a1a-90d58cd8dfbd tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "GET /v2.0/networks?id=8558262b-7125-4688-a6ea-2f1d2c3b2876 HTTP/1.1" status: 200 len: 815 time: 0.1396103 Nov 24 11:17:27.824577 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Request body: {'port': {'device_id': '16be8a18-2ef0-4454-952b-aaf5990c5ada', 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876', 'admin_state_up': True, 'tenant_id': 'fae8312f669b48b797904792401edfa4'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:17:28.047324 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Made reservation on behalf of fae8312f669b48b797904792401edfa4 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:17:28.050941 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:28.107393 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e12090f0-8e1d-4274-9167-e0da88821e2f req-bbbbfbb7-cbfb-4ff8-8a4e-ec43c840f580 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:28.109202 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e12090f0-8e1d-4274-9167-e0da88821e2f req-bbbbfbb7-cbfb-4ff8-8a4e-ec43c840f580 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0693691 Nov 24 11:17:28.122051 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 57204) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:28.177623 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e12090f0-8e1d-4274-9167-e0da88821e2f req-984909b8-d8bd-4d5d-b6c9-14cda3626106 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0620723 Nov 24 11:17:28.258789 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Allocated IP 172.20.0.14 (8558262b-7125-4688-a6ea-2f1d2c3b2876/cd868cb4-b7fb-4350-b027-a21baabac768/7041b264-1b4e-4b52-9407-c7681bd79d2b) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:17:28.296821 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a800bafe-73d1-498d-96da-7755364e5dcf req-f87235b7-85bc-4e7f-9097-c4bbba3d0d7f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 210 time: 0.0758851 Nov 24 11:17:28.304836 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1890588899-network', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:17:28.435341 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Made reservation on behalf of 41b5f46d34ad4033a154a9afabe2091f for: {'network': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:17:28.437687 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:28.441743 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:28.447590 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:28.533987 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:28.624649 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:28.637227 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['af19a68f-fbb1-4d8c-9034-627d69f6dfd0', '5e1dd2e6-fe77-43bc-98bf-f1a63705734c', '4937438f-b5f9-45ee-9f52-e426878caa7d'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:17:28.669537 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Network 8558262b-7125-4688-a6ea-2f1d2c3b2876 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:17:28.672480 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:17:28.676095 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:17:28.682655 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:28.682655 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:28.690944 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Pushing event updated for resources: {'Port': ['ID=7041b264-1b4e-4b52-9407-c7681bd79d2b,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:28.755466 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:28.786534 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1225} {{(pid=103244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:17:28.797064 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=77852028-b8f9-4fe3-8362-a7373cc59d6b,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:28.801895 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:28.802238 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.segments_db [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Added segment 71343ab0-4290-4798-8417-9a4b559b66e3 of type vlan for network c3a531f2-bfe9-4a80-8b71-ad7f35944879 Nov 24 11:17:28.843474 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:28.872907 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-0d497a9e-9dc6-4af4-9a53-d00825eecc90 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0527995 Nov 24 11:17:28.887467 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Request body: {'port': {'device_id': '16be8a18-2ef0-4454-952b-aaf5990c5ada', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:17:28.944471 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:28.946397 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:28.946397 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:28.970994 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:29.050044 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] Pushing event updated for resources: {'Network': ['ID=c3a531f2-bfe9-4a80-8b71-ad7f35944879,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:29.064996 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network c3a531f2-bfe9-4a80-8b71-ad7f35944879 details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:17:29.151906 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-c9960fd4-547c-4828-95ca-dc21f1d4cb8f admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 1.0273983 Nov 24 11:17:29.154897 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 57224) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:29.160631 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-3ec5f9c3-d49d-4438-be32-3aad75776096 admin admin] Request body: {'subnet': {'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1890588899-subnet', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'ip_version': 4}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:17:29.279863 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7041b264-1b4e-4b52-9407-c7681bd79d2b {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:17:29.288395 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:29.299530 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ec5f9c3-d49d-4438-be32-3aad75776096 admin admin] Made reservation on behalf of 41b5f46d34ad4033a154a9afabe2091f for: {'subnet': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:17:29.300508 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Transition to ACTIVE for port object 7041b264-1b4e-4b52-9407-c7681bd79d2b will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:17:29.301821 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3ec5f9c3-d49d-4438-be32-3aad75776096 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8480549'] for subnet, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:29.330458 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54a045df-afb6-4a3d-b56b-96a27fafbd8a req-e9fab0e6-1c8a-49e3-9c4c-e4dabcd32e9b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:29.331980 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-54a045df-afb6-4a3d-b56b-96a27fafbd8a req-e9fab0e6-1c8a-49e3-9c4c-e4dabcd32e9b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0729179 Nov 24 11:17:29.389971 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:29.431545 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-54a045df-afb6-4a3d-b56b-96a27fafbd8a req-43cfc54e-052c-4bea-9753-6933b3bfd5a7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0926909 Nov 24 11:17:29.455747 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Pushing event updated for resources: {'Port': ['ID=7041b264-1b4e-4b52-9407-c7681bd79d2b,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:29.499921 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Attempting to bind port 7041b264-1b4e-4b52-9407-c7681bd79d2b on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:17:29.500251 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Attempting to bind port 7041b264-1b4e-4b52-9407-c7681bd79d2b by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:17:29.500573 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Attempting to bind port 7041b264-1b4e-4b52-9407-c7681bd79d2b on network 8558262b-7125-4688-a6ea-2f1d2c3b2876 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:17:29.504532 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b215a021-6d1f-4477-8408-f7978d51438f req-b84cb204-3dbf-40c2-a5e0-d448aa8d8780 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:29.504903 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Port 7041b264-1b4e-4b52-9407-c7681bd79d2b on network 8558262b-7125-4688-a6ea-2f1d2c3b2876 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:17:29.505223 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Attempting to bind port 7041b264-1b4e-4b52-9407-c7681bd79d2b on network 8558262b-7125-4688-a6ea-2f1d2c3b2876 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:17:29.506480 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b215a021-6d1f-4477-8408-f7978d51438f req-b84cb204-3dbf-40c2-a5e0-d448aa8d8780 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 944 time: 0.0879846 Nov 24 11:17:29.510855 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 17, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:17:29.511184 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Checking segment: {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:17:29.511592 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Bound using segment: {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:17:29.512014 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Bound port: 7041b264-1b4e-4b52-9407-c7681bd79d2b, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '66147b3f-41b0-4ec8-96ba-af958618b639', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1227, 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:17:29.512365 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:29.576049 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] For port 7041b264-1b4e-4b52-9407-c7681bd79d2b, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:17:29.580604 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] For port 7041b264-1b4e-4b52-9407-c7681bd79d2b, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=7041b264-1b4e-4b52-9407-c7681bd79d2b,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:17:29.631261 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e40d8f2-e64a-4f81-9ba9-8cdd2b7c7b0a req-977a5782-4929-4f4e-82ba-2890e399619f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:29.632775 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e40d8f2-e64a-4f81-9ba9-8cdd2b7c7b0a req-977a5782-4929-4f4e-82ba-2890e399619f service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=30efcb46099b42a3a76be0d52d0d0213&device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 1099 time: 0.0407500 Nov 24 11:17:29.633145 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7f3563-7c5b-4a8a-b080-539556d3a732 req-4cdfc3c3-2007-4410-81b9-1f3ce2f15c7c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:29.634616 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3a7f3563-7c5b-4a8a-b080-539556d3a732 req-4cdfc3c3-2007-4410-81b9-1f3ce2f15c7c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.1387749 Nov 24 11:17:29.638286 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b215a021-6d1f-4477-8408-f7978d51438f req-3476624d-bd8b-401d-8bbe-13d0ab0c2f5d tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1182735 Nov 24 11:17:29.661163 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:29.687529 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3a7f3563-7c5b-4a8a-b080-539556d3a732 req-4f6a9fa9-10f5-43c4-a14b-ab7c1c794971 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468268 Nov 24 11:17:29.698263 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3ec5f9c3-d49d-4438-be32-3aad75776096 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8698972', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8480535'] for subnet, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:29.734968 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:29.735600 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:29.736972 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] 10.222.0.86 "PUT /v2.0/ports/7041b264-1b4e-4b52-9407-c7681bd79d2b HTTP/1.1" status: 200 len: 1094 time: 0.8542671 Nov 24 11:17:29.737414 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16be8a18-2ef0-4454-952b-aaf5990c5ada', 'tag': '7041b264-1b4e-4b52-9407-c7681bd79d2b'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:17:29.739650 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14852fcb-8cf6-4dba-a0f2-691788249c86" -d '{"events": [{"name": "network-changed", "server_uuid": "16be8a18-2ef0-4454-952b-aaf5990c5ada", "tag": "7041b264-1b4e-4b52-9407-c7681bd79d2b"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:17:29.764287 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ec5f9c3-d49d-4438-be32-3aad75776096 admin admin] Pushing event updated for resources: {'Subnet': ['ID=08393eb4-7b60-4211-937a-8e0724891dbc,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:29.772205 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ec5f9c3-d49d-4438-be32-3aad75776096 admin admin] Checking segment: {'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:17:29.773086 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ec5f9c3-d49d-4438-be32-3aad75776096 admin admin] Network hostable DHCP agents. Network: c3a531f2-bfe9-4a80-8b71-ad7f35944879, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:17:29.785177 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cff53179-b3ca-4ac3-9ac8-ec55879ce625 service neutron] Pushing event updated for resources: {'Port': ['ID=7041b264-1b4e-4b52-9407-c7681bd79d2b,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:29.792799 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e40d8f2-e64a-4f81-9ba9-8cdd2b7c7b0a req-48139591-ecd0-4304-91cf-0ec984de560b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:29.794253 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e40d8f2-e64a-4f81-9ba9-8cdd2b7c7b0a req-48139591-ecd0-4304-91cf-0ec984de560b service neutron] 10.222.0.86 "GET /v2.0/networks?id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a HTTP/1.1" status: 200 len: 921 time: 0.1517913 Nov 24 11:17:29.806588 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:17:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6a93f31d-0995-4b11-9282-76600c7fabc1 x-openstack-request-id: req-6a93f31d-0995-4b11-9282-76600c7fabc1 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:17:29.806881 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16be8a18-2ef0-4454-952b-aaf5990c5ada", "tag": "7041b264-1b4e-4b52-9407-c7681bd79d2b", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:17:29.807131 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-6a93f31d-0995-4b11-9282-76600c7fabc1 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:17:29.807555 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16be8a18-2ef0-4454-952b-aaf5990c5ada', 'tag': '7041b264-1b4e-4b52-9407-c7681bd79d2b', 'status': 'completed', 'code': 200} Nov 24 11:17:29.855531 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e40d8f2-e64a-4f81-9ba9-8cdd2b7c7b0a req-8c796907-6612-4d7a-ba1a-1d3b819326d2 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bc9cf739-16b6-4224-a3fd-869dd9adb0f4 HTTP/1.1" status: 200 len: 217 time: 0.0456898 Nov 24 11:17:29.863935 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3ec5f9c3-d49d-4438-be32-3aad75776096 admin admin] Network c3a531f2-bfe9-4a80-8b71-ad7f35944879 is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:17:29.921401 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14852fcb-8cf6-4dba-a0f2-691788249c86 req-9a994d91-0136-48eb-aa5b-69a41ee6bfea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:29.922864 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-14852fcb-8cf6-4dba-a0f2-691788249c86 req-9a994d91-0136-48eb-aa5b-69a41ee6bfea service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 1097 time: 0.0764358 Nov 24 11:17:29.928048 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e40d8f2-e64a-4f81-9ba9-8cdd2b7c7b0a req-9ad6593b-253a-4156-92b8-6171f55f3a04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:29.932403 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e40d8f2-e64a-4f81-9ba9-8cdd2b7c7b0a req-9ad6593b-253a-4156-92b8-6171f55f3a04 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=e89fe7df-9fbd-43c3-9f7a-0597324b938f HTTP/1.1" status: 200 len: 859 time: 0.0572042 Nov 24 11:17:29.954080 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-3ec5f9c3-d49d-4438-be32-3aad75776096 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, c3a531f2-bfe9-4a80-8b71-ad7f35944879) {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:17:29.956445 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ec5f9c3-d49d-4438-be32-3aad75776096 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:29.957023 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3ec5f9c3-d49d-4438-be32-3aad75776096 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:29.965066 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b480bff-1a3e-492c-9c6f-106908f8ce96 None None] Network c3a531f2-bfe9-4a80-8b71-ad7f35944879 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:17:29.978041 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea139fc4-163d-4667-810c-1064c6c76486 req-7736fd84-6b42-421c-a425-482133b8f918 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:29.979776 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ea139fc4-163d-4667-810c-1064c6c76486 req-7736fd84-6b42-421c-a425-482133b8f918 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 1099 time: 0.0552666 Nov 24 11:17:29.986458 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e40d8f2-e64a-4f81-9ba9-8cdd2b7c7b0a req-cf8d5fb7-1b93-410e-bebd-0812ec38e529 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0356610 Nov 24 11:17:30.045603 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-3ec5f9c3-d49d-4438-be32-3aad75776096 admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.8896346 Nov 24 11:17:30.050213 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 57238) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:30.058502 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:17:30.131381 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14852fcb-8cf6-4dba-a0f2-691788249c86 req-f623ef3e-1f0a-4ab9-97b5-bf960d2bf5e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:30.132684 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1e1181f3-c521-552f-a8c5-b0ec988a193c-c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'fixed_ips': [{'subnet_id': '08393eb4-7b60-4211-937a-8e0724891dbc'}]}} from dv-cinder-804035-18-iscsi. {{(pid=103245) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 11:17:30.132855 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-14852fcb-8cf6-4dba-a0f2-691788249c86 req-f623ef3e-1f0a-4ab9-97b5-bf960d2bf5e7 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=fae8312f669b48b797904792401edfa4&shared=False HTTP/1.1" status: 200 len: 917 time: 0.1902807 Nov 24 11:17:30.133665 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:30.155106 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea139fc4-163d-4667-810c-1064c6c76486 req-887a50be-a8d8-4481-ac75-e9aea15d4434 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:30.156599 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ea139fc4-163d-4667-810c-1064c6c76486 req-887a50be-a8d8-4481-ac75-e9aea15d4434 service neutron] 10.222.0.86 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 919 time: 0.1691463 Nov 24 11:17:30.186092 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e40d8f2-e64a-4f81-9ba9-8cdd2b7c7b0a req-e822baed-80ca-4c13-951b-fdd67a5abb17 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1885464 Nov 24 11:17:30.259347 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ea139fc4-163d-4667-810c-1064c6c76486 req-de8f4072-c25c-4617-8239-a8bcc93d7351 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 HTTP/1.1" status: 200 len: 1002 time: 0.0905552 Nov 24 11:17:30.271287 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.db_base_plugin_common [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Allocated IP 172.20.0.2 (c3a531f2-bfe9-4a80-8b71-ad7f35944879/08393eb4-7b60-4211-937a-8e0724891dbc/837493e4-10b5-44b3-a94e-2a49a078d343) {{(pid=103245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:17:30.289202 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1010094', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:30.290222 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1009794', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-534758', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-985777', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-654'] for router, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:30.314677 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14852fcb-8cf6-4dba-a0f2-691788249c86 req-bcf75083-cfe8-4f29-b60c-e023d221a4de service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:30.316180 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-14852fcb-8cf6-4dba-a0f2-691788249c86 req-bcf75083-cfe8-4f29-b60c-e023d221a4de service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1711049 Nov 24 11:17:30.371866 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e40d8f2-e64a-4f81-9ba9-8cdd2b7c7b0a req-63f1d31d-bb86-4b57-a689-af5890571610 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1565545 Nov 24 11:17:30.398391 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:30.416329 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7975bb75-960b-4d5e-b179-24b21946206d req-83d2469d-bb12-4c1a-813d-7b3f83d33398 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:30.418052 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-83d2469d-bb12-4c1a-813d-7b3f83d33398 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=fae8312f669b48b797904792401edfa4&device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 1097 time: 0.0486696 Nov 24 11:17:30.441445 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Publish callbacks [] for port, precommit_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:30.468532 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-ec049d26-9bea-4f7e-9148-4ed3abfba1f3 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=7041b264-1b4e-4b52-9407-c7681bd79d2b HTTP/1.1" status: 200 len: 217 time: 0.0393453 Nov 24 11:17:30.534598 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:30.569042 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea139fc4-163d-4667-810c-1064c6c76486 req-940ef945-feff-4781-99c9-0a537fde62a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:30.570525 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ea139fc4-163d-4667-810c-1064c6c76486 req-940ef945-feff-4781-99c9-0a537fde62a4 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=5eae2e87-935a-45b7-89da-586ce04ad644 HTTP/1.1" status: 200 len: 856 time: 0.2996566 Nov 24 11:17:30.590145 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-053e546f-8cd8-495e-919d-26120545458f req-1846fa4e-a9e9-4a74-b96c-d23367297cf0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:30.591622 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-053e546f-8cd8-495e-919d-26120545458f req-1846fa4e-a9e9-4a74-b96c-d23367297cf0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0630744 Nov 24 11:17:30.591754 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Pushing event updated for resources: {'Port': ['ID=837493e4-10b5-44b3-a94e-2a49a078d343,revision_number=1']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:30.595046 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Network c3a531f2-bfe9-4a80-8b71-ad7f35944879 is already hosted by enough agents. {{(pid=103245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:17:30.596776 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.base_scheduler [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Resources bound (agent type, host, resource id): {{(pid=103245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:17:30.605773 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Received port after_create {{(pid=103245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:17:30.674456 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Attempting to bind port 837493e4-10b5-44b3-a94e-2a49a078d343 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:17:30.674841 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea139fc4-163d-4667-810c-1064c6c76486 req-492c64e7-6a51-49b6-a326-e691586abe51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:30.675043 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Attempting to bind port 837493e4-10b5-44b3-a94e-2a49a078d343 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:17:30.675667 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Attempting to bind port 837493e4-10b5-44b3-a94e-2a49a078d343 on network c3a531f2-bfe9-4a80-8b71-ad7f35944879 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:17:30.676398 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ea139fc4-163d-4667-810c-1064c6c76486 req-492c64e7-6a51-49b6-a326-e691586abe51 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=76fcee22-81e5-4608-a546-3b68c56c5ac7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0837989 Nov 24 11:17:30.686429 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 17, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:17:30.686957 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Checking segment: {'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:17:30.687633 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:30.688004 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Bound using segment: {'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:17:30.688597 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Bound port: 837493e4-10b5-44b3-a94e-2a49a078d343, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:17:30.689320 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-053e546f-8cd8-495e-919d-26120545458f req-78caa9b6-157b-4a28-966f-9f6a1cba99eb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0707629 Nov 24 11:17:30.703780 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:30.822368 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] For port 837493e4-10b5-44b3-a94e-2a49a078d343, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:17:30.825856 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] For port 837493e4-10b5-44b3-a94e-2a49a078d343, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=837493e4-10b5-44b3-a94e-2a49a078d343,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:17:30.834081 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ea139fc4-163d-4667-810c-1064c6c76486 req-58f0e283-228c-4282-a47f-beccf296963f service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1436441 Nov 24 11:17:30.841800 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44891372-67fe-4864-8a79-af5419989762 req-c83f5e08-2171-4fc8-b7d6-99771cb19ff3 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:30.842826 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-44891372-67fe-4864-8a79-af5419989762 req-c83f5e08-2171-4fc8-b7d6-99771cb19ff3 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 944 time: 0.1137652 Nov 24 11:17:30.882429 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7975bb75-960b-4d5e-b179-24b21946206d req-fdbddb65-12d5-470e-b301-b17d32141cec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:30.883942 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-fdbddb65-12d5-470e-b301-b17d32141cec service neutron] 10.222.0.86 "GET /v2.0/subnets?id=cd868cb4-b7fb-4350-b027-a21baabac768 HTTP/1.1" status: 200 len: 855 time: 0.3825719 Nov 24 11:17:30.887422 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:30.892937 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:30.930429 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-9c8a6fc3-e8ab-41ab-a7b8-f56ef959fc7f service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=8558262b-7125-4688-a6ea-2f1d2c3b2876&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0265808 Nov 24 11:17:30.964932 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d1b7973-1edd-4945-8419-129ffab1163a None None] Pushing event updated for resources: {'Port': ['ID=837493e4-10b5-44b3-a94e-2a49a078d343,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:30.983615 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a6416d-275a-4e79-96c6-945c97a0f924 req-f2b7d06b-5918-4a8e-bfe2-b8184fe5cc77 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:30.985152 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-10a6416d-275a-4e79-96c6-945c97a0f924 req-f2b7d06b-5918-4a8e-bfe2-b8184fe5cc77 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.1673911 Nov 24 11:17:30.990904 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-44891372-67fe-4864-8a79-af5419989762 req-e2d9ca89-569c-42a8-beb5-e5e7bd9a7f50 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1383624 Nov 24 11:17:31.026949 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ea139fc4-163d-4667-810c-1064c6c76486 req-3a263901-6b8b-49ad-8662-ef1161f55358 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1831381 Nov 24 11:17:31.062335 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-10a6416d-275a-4e79-96c6-945c97a0f924 req-137a0b4f-58bd-41a5-ac55-469499cfd6cf tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673218 Nov 24 11:17:31.063798 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-432e2502-29de-4cfb-822e-2178b81dc1a1 service neutron] 10.222.0.86 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1245818 Nov 24 11:17:31.207648 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7975bb75-960b-4d5e-b179-24b21946206d req-1721cd6a-95b2-4930-9bf3-87a694541a3c service neutron] 10.222.0.86 "GET /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1353252 Nov 24 11:17:31.321521 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:31.341141 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:31.442144 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Allocated IP 172.27.3.59 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/0b6945a0-371d-4113-8209-5fa0406ef613) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:17:31.544799 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:31.658869 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:31.701627 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:17:31.704768 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:17:31.708448 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:17:31.772954 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Pushing event updated for resources: {'Port': ['ID=0b6945a0-371d-4113-8209-5fa0406ef613,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:31.846138 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1867d99a-b7a1-4994-806e-1178501cd625 req-a548f178-c4d9-4777-822f-e96930bc0784 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:31.848251 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1867d99a-b7a1-4994-806e-1178501cd625 req-a548f178-c4d9-4777-822f-e96930bc0784 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0540793 Nov 24 11:17:31.901274 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1867d99a-b7a1-4994-806e-1178501cd625 req-39bd8621-88a4-4b15-a864-9bc71c53e80e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460544 Nov 24 11:17:31.941527 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe828501-1796-4faf-ae91-b6b1be23dbb5 None None] Network c3a531f2-bfe9-4a80-8b71-ad7f35944879 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:17:32.010569 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:32.011504 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-0ee4d99f-e793-42f4-856f-ed147b4909e1 None None] Provisioning complete for port 837493e4-10b5-44b3-a94e-2a49a078d343 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:32.011939 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0ee4d99f-e793-42f4-856f-ed147b4909e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:32.128009 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e6fb17e-a071-44f5-97e1-e0d5dc62b240 req-98204c8a-5173-4d52-bf0b-a6ef76a2f04c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:32.135286 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1e6fb17e-a071-44f5-97e1-e0d5dc62b240 req-98204c8a-5173-4d52-bf0b-a6ef76a2f04c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 944 time: 0.0644591 Nov 24 11:17:32.195810 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0ee4d99f-e793-42f4-856f-ed147b4909e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:32.219313 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1e6fb17e-a071-44f5-97e1-e0d5dc62b240 req-5b03571d-05dc-48e8-8714-7e03c14c2846 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0824947 Nov 24 11:17:32.235428 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-0ee4d99f-e793-42f4-856f-ed147b4909e1 None None] For port 837493e4-10b5-44b3-a94e-2a49a078d343, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=837493e4-10b5-44b3-a94e-2a49a078d343,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:32.237556 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cf0773a-08ca-43fc-a8ea-47e158c6defb req-95c1b75b-f11d-43aa-82d6-a6c8eaa94e14 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:32.240430 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9cf0773a-08ca-43fc-a8ea-47e158c6defb req-95c1b75b-f11d-43aa-82d6-a6c8eaa94e14 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0857606 Nov 24 11:17:32.309138 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9cf0773a-08ca-43fc-a8ea-47e158c6defb req-474e01b9-eb53-46bf-b724-6af3f63aaaca tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624681 Nov 24 11:17:32.310713 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0ee4d99f-e793-42f4-856f-ed147b4909e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:32.324688 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1009813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-942685'] for router, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:32.361861 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ee4d99f-e793-42f4-856f-ed147b4909e1 None None] Pushing event updated for resources: {'Port': ['ID=837493e4-10b5-44b3-a94e-2a49a078d343,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:32.530383 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-43689682-51fb-41c9-9433-35a1477a02fe None None] Provisioning complete for port 837493e4-10b5-44b3-a94e-2a49a078d343 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:32.530671 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-43689682-51fb-41c9-9433-35a1477a02fe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:32.560264 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Router 0d8adae3-0d48-4940-84b4-9800d498d230 is scheduled to L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 with binding_index 1 {{(pid=103243) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 11:17:32.665135 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:17:32.675707 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Sync routers for ids ['0d8adae3-0d48-4940-84b4-9800d498d230'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:17:32.684641 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Routers {'0d8adae3-0d48-4940-84b4-9800d498d230'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:17:32.694485 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:17:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['0d8adae3-0d48-4940-84b4-9800d498d230'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:32.762790 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] Publish callbacks [] for router, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:32.764166 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-099a8826-201e-4a4b-811a-593764fdb64e admin admin] 10.222.0.76 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.7111444 Nov 24 11:17:32.766927 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 57256) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:32.786030 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Set router 0d8adae3-0d48-4940-84b4-9800d498d230 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:17:32.871475 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:17:32.956972 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:32.970000 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:17:31Z', 'revision_number': 3, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:32.994519 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:17:32.997429 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8fd52a2b-e957-468a-b7bc-cd4ea3049abc" -d '{"events": [{"server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "name": "network-vif-unplugged", "status": "completed", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:17:32.997671 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Checking router: 0d8adae3-0d48-4940-84b4-9800d498d230 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:17:32.998228 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Updating router 0d8adae3-0d48-4940-84b4-9800d498d230 port 0b6945a0-371d-4113-8209-5fa0406ef613 binding host dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:17:33.003684 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:33.055401 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Wed, 24 Nov 2021 11:17:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18c2ab7b-b3ec-4df4-8a81-af526f9a0635 x-openstack-request-id: req-18c2ab7b-b3ec-4df4-8a81-af526f9a0635 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:17:33.055401 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "name": "network-vif-unplugged", "status": "completed", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:17:33.055401 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-18c2ab7b-b3ec-4df4-8a81-af526f9a0635 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:17:33.055401 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'code': 200} Nov 24 11:17:33.055801 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.097273 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8bdfaff-41bf-4d0d-a248-eeeeb0a6a8a8 req-f138f2a3-aab4-4a9c-a5bf-972f816ffb75 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:33.107494 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 837493e4-10b5-44b3-a94e-2a49a078d343 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:17:33.107708 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f8bdfaff-41bf-4d0d-a248-eeeeb0a6a8a8 req-f138f2a3-aab4-4a9c-a5bf-972f816ffb75 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 946 time: 0.0746875 Nov 24 11:17:33.142796 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.169970 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f8bdfaff-41bf-4d0d-a248-eeeeb0a6a8a8 req-3e24d1e8-dfb0-4478-a803-266a0b527e8e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0597641 Nov 24 11:17:33.200005 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 837493e4-10b5-44b3-a94e-2a49a078d343 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:33.200531 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.243741 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,revision_number=8']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:33.283435 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.360490 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Publish callbacks [] for port, precommit_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.416220 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-052e0f16-c3b6-4e98-9adc-e4583bcb9fb9 req-54dc9304-d291-4339-9d0e-6c6a085cbaa4 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:33.417746 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-052e0f16-c3b6-4e98-9adc-e4583bcb9fb9 req-54dc9304-d291-4339-9d0e-6c6a085cbaa4 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 944 time: 0.0824747 Nov 24 11:17:33.441414 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.485736 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6972951-87b9-4167-9397-6ccfb7305ceb req-8459b84b-0487-420e-9fde-6d5273d5c4a1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:33.487088 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f6972951-87b9-4167-9397-6ccfb7305ceb req-8459b84b-0487-420e-9fde-6d5273d5c4a1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0932424 Nov 24 11:17:33.487406 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Allocated IP 172.20.0.1 (c3a531f2-bfe9-4a80-8b71-ad7f35944879/08393eb4-7b60-4211-937a-8e0724891dbc/3c193dd0-ad65-44b5-b059-da55dd5857b0) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:17:33.494193 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Pushing event updated for resources: {'Port': ['ID=0b6945a0-371d-4113-8209-5fa0406ef613,revision_number=2']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:33.509456 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-052e0f16-c3b6-4e98-9adc-e4583bcb9fb9 req-8a4dac85-2137-468b-a1b8-317dda44d8b7 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0769856 Nov 24 11:17:33.513213 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Attempting to bind port 0b6945a0-371d-4113-8209-5fa0406ef613 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Attempting to bind port 0b6945a0-371d-4113-8209-5fa0406ef613 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Attempting to bind port 0b6945a0-371d-4113-8209-5fa0406ef613 on network fa6231d1-a629-42bc-a091-20035dee3542 {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:33.535330 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:17:33.536527 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 17, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:17:33.536527 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Checking segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:17:33.536527 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.536527 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Bound using segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:17:33.536527 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Bound port: 0b6945a0-371d-4113-8209-5fa0406ef613, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:17:33.536527 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.552158 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f6972951-87b9-4167-9397-6ccfb7305ceb req-3247b1eb-c220-41db-8b16-ab43b6496f80 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0563738 Nov 24 11:17:33.590664 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] For port 0b6945a0-371d-4113-8209-5fa0406ef613, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:17:33.593821 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] For port 0b6945a0-371d-4113-8209-5fa0406ef613, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=0b6945a0-371d-4113-8209-5fa0406ef613,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:17:33.602361 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.658890 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.687633 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.711771 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Routers {'0d8adae3-0d48-4940-84b4-9800d498d230'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:17:33.712378 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:17:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['0d8adae3-0d48-4940-84b4-9800d498d230'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:33.732762 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Network c3a531f2-bfe9-4a80-8b71-ad7f35944879 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:17:33.735609 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:17:33.738991 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:17:33.739677 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1009482'] for router_interface, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.759531 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-467d57e1-9c98-4de7-abe1-18aa242f3e28 None None] Pushing event updated for resources: {'Port': ['ID=0b6945a0-371d-4113-8209-5fa0406ef613,revision_number=3']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:33.776098 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Pushing event updated for resources: {'Port': ['ID=3c193dd0-ad65-44b5-b059-da55dd5857b0,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:33.844215 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] Set router 0d8adae3-0d48-4940-84b4-9800d498d230 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:17:33.939842 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-9da845fb-46a0-450d-aacd-52cd0baceb9c None None] Provisioning complete for port 3c193dd0-ad65-44b5-b059-da55dd5857b0 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:33.940441 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-9da845fb-46a0-450d-aacd-52cd0baceb9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.963967 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:33.979093 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-9da845fb-46a0-450d-aacd-52cd0baceb9c None None] Port 3c193dd0-ad65-44b5-b059-da55dd5857b0 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:17:34.037775 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:17:31Z', 'revision_number': 3, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:34.066209 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1c190475-9dc7-4890-b414-8abcd1ded513 None None] The sync data for ids ['0d8adae3-0d48-4940-84b4-9800d498d230'] in dv-cinder-804035-18-iscsi is: [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:17:31Z', 'revision_number': 3, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:33Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:17:34.128080 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:34.195926 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:34.196571 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-636370', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1009638'] for router_interface, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:34.263591 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Pushing event updated for resources: {'Port': ['ID=3c193dd0-ad65-44b5-b059-da55dd5857b0,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:34.332412 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c45594-4cea-47a2-81b7-9ec994759dcd req-ed6e98a9-8816-4504-beb1-4ea407b0df28 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:34.334056 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e3c45594-4cea-47a2-81b7-9ec994759dcd req-ed6e98a9-8816-4504-beb1-4ea407b0df28 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0865757 Nov 24 11:17:34.358883 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Network c3a531f2-bfe9-4a80-8b71-ad7f35944879 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:17:34.360504 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:17:34.403866 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e3c45594-4cea-47a2-81b7-9ec994759dcd req-0fcd2e16-1583-48d4-bffc-1f7bb9a0dc85 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0630322 Nov 24 11:17:34.507620 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Router 0d8adae3-0d48-4940-84b4-9800d498d230 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:17:34.674944 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-270b31c6-2bd1-41f9-9101-b9f088ba5fee req-67336d23-c510-4fba-9314-2a9013b07e32 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:34.677012 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-270b31c6-2bd1-41f9-9101-b9f088ba5fee req-67336d23-c510-4fba-9314-2a9013b07e32 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 944 time: 0.0785954 Nov 24 11:17:34.709853 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-5d8b403f-d94f-48d0-847f-9ea3e99ebc0d None None] Provisioning complete for port 3c193dd0-ad65-44b5-b059-da55dd5857b0 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:34.710524 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5d8b403f-d94f-48d0-847f-9ea3e99ebc0d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:34.736906 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-270b31c6-2bd1-41f9-9101-b9f088ba5fee req-6bf0cfb9-9cd4-4407-bbdf-488149997051 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528393 Nov 24 11:17:34.757819 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-5d8b403f-d94f-48d0-847f-9ea3e99ebc0d None None] Port 3c193dd0-ad65-44b5-b059-da55dd5857b0 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:17:34.870013 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10a879e4-fb58-4e94-8066-4b3695540d4b req-a2c77f89-0687-4f5a-9f06-0d967f56d6ed tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:34.871892 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-10a879e4-fb58-4e94-8066-4b3695540d4b req-a2c77f89-0687-4f5a-9f06-0d967f56d6ed tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0606830 Nov 24 11:17:34.872419 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 7041b264-1b4e-4b52-9407-c7681bd79d2b details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:17:34.899698 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:17:34.913775 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-7fb5ece4-8962-4f02-a983-8eec342c3833 admin admin] 10.222.0.76 "PUT /v2.0/routers/0d8adae3-0d48-4940-84b4-9800d498d230/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1456711 Nov 24 11:17:34.965985 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-10a879e4-fb58-4e94-8066-4b3695540d4b req-7670ec81-cd26-414f-9119-569dd9338f2c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0831864 Nov 24 11:17:35.017217 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 7041b264-1b4e-4b52-9407-c7681bd79d2b, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=7041b264-1b4e-4b52-9407-c7681bd79d2b,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:35.028094 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 0b6945a0-371d-4113-8209-5fa0406ef613 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:17:35.033168 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '7041b264-1b4e-4b52-9407-c7681bd79d2b', 'network_id': '8558262b-7125-4688-a6ea-2f1d2c3b2876', 'port_id': '7041b264-1b4e-4b52-9407-c7681bd79d2b', 'mac_address': 'fa:16:3e:3f:ce:a0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1227, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cd868cb4-b7fb-4350-b027-a21baabac768', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:17:35.108791 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:35.130081 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7041b264-1b4e-4b52-9407-c7681bd79d2b {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:17:35.147330 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 0b6945a0-371d-4113-8209-5fa0406ef613 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:35.147698 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:35.172347 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 7041b264-1b4e-4b52-9407-c7681bd79d2b, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=7041b264-1b4e-4b52-9407-c7681bd79d2b,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:35.237635 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:35.243992 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:35.298459 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] For port 0b6945a0-371d-4113-8209-5fa0406ef613, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=0b6945a0-371d-4113-8209-5fa0406ef613,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:35.310299 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=7041b264-1b4e-4b52-9407-c7681bd79d2b,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:35.356707 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:35.408025 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Pushing event updated for resources: {'Port': ['ID=0b6945a0-371d-4113-8209-5fa0406ef613,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:35.553915 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['7041b264-1b4e-4b52-9407-c7681bd79d2b'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:17:35.612077 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [req-12490642-0f4b-4a1c-9180-d9cf7cf4c417 req-7f9c8c48-5db0-4a31-81fc-58ccfbcf7d37 service neutron] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:17:35.613067 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-12490642-0f4b-4a1c-9180-d9cf7cf4c417 req-7f9c8c48-5db0-4a31-81fc-58ccfbcf7d37 service neutron] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053594 Nov 24 11:17:35.636084 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 57302) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:35.641178 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1938436293-network', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:17:35.738499 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Made reservation on behalf of c0d223d26f5146fc9e583ac067c520d4 for: {'network': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:17:35.741120 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:35.751511 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:35.794333 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Sync routers for ids ['0d8adae3-0d48-4940-84b4-9800d498d230'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:17:35.808864 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Routers {'0d8adae3-0d48-4940-84b4-9800d498d230'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:17:35.809684 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:17:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['0d8adae3-0d48-4940-84b4-9800d498d230'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:35.837467 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:35.890154 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43f578f7-5a31-41f9-bc8a-dc65651ad5b8 req-b904bb00-0717-4cb2-af85-ed042f9e6926 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:35.891790 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-43f578f7-5a31-41f9-bc8a-dc65651ad5b8 req-b904bb00-0717-4cb2-af85-ed042f9e6926 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 945 time: 0.0667644 Nov 24 11:17:35.915634 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:35.933140 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1232} {{(pid=103243) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:17:35.938542 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Set router 0d8adae3-0d48-4940-84b4-9800d498d230 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:17:35.958217 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:35.959036 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.segments_db [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Added segment fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3 of type vlan for network 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 Nov 24 11:17:35.969340 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5161b1aa-973a-4166-b3f1-0fd10fd6de51,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:35.978546 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-43f578f7-5a31-41f9-bc8a-dc65651ad5b8 req-4b53d7ba-7c23-4625-9952-239aafee7dd9 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790939 Nov 24 11:17:36.011087 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c02302d3-7bae-4000-9a88-ac3e09a576b3 req-77c5efb7-fa15-434f-9472-3ff07a38e4c5 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:36.012635 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c02302d3-7bae-4000-9a88-ac3e09a576b3 req-77c5efb7-fa15-434f-9472-3ff07a38e4c5 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0833607 Nov 24 11:17:36.032913 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:36.126830 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:36.127841 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:36.128420 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:36.136822 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c02302d3-7bae-4000-9a88-ac3e09a576b3 req-452e7bc0-b0b7-401a-86cb-edcd0bbaccf2 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1163754 Nov 24 11:17:36.164563 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c6dbb6-e2e8-44e8-a68e-5520609521b2 req-af710aa6-e966-4c84-9de0-a979ba75e67f tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:36.166070 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d6c6dbb6-e2e8-44e8-a68e-5520609521b2 req-af710aa6-e966-4c84-9de0-a979ba75e67f tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.1071951 Nov 24 11:17:36.200298 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] Pushing event updated for resources: {'Network': ['ID=005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:36.219750 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-fc4cbb74-dbb4-4cde-9f78-167faccd83e1 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.5823495 Nov 24 11:17:36.222580 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 57320) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:36.226093 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:17:36.230588 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-b95caa16-79ed-467d-8bf8-5e84111a2648 admin admin] Request body: {'subnet': {'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1938436293-subnet', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'ip_version': 4}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:17:36.235096 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d6c6dbb6-e2e8-44e8-a68e-5520609521b2 req-517c9109-d599-4f90-98d6-3772feab2695 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507748 Nov 24 11:17:36.333301 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b95caa16-79ed-467d-8bf8-5e84111a2648 admin admin] Made reservation on behalf of c0d223d26f5146fc9e583ac067c520d4 for: {'subnet': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:17:36.336378 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-b95caa16-79ed-467d-8bf8-5e84111a2648 admin admin] Publish callbacks [] for subnet, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:36.369970 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:17:33Z', 'revision_number': 4, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3c193dd0-ad65-44b5-b059-da55dd5857b0', 'name': '', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'mac_address': 'fa:16:3e:0f:1e:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:33Z', 'updated_at': '2021-11-24T11:17:34Z', 'revision_number': 2, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'subnets': [{'id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:36.396225 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Checking router: 0d8adae3-0d48-4940-84b4-9800d498d230 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:17:36.397263 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Updating router 0d8adae3-0d48-4940-84b4-9800d498d230 port 3c193dd0-ad65-44b5-b059-da55dd5857b0 binding host dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:17:36.423821 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:36.567748 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-b95caa16-79ed-467d-8bf8-5e84111a2648 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for subnet, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:36.606301 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 57330) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:36.625686 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b95caa16-79ed-467d-8bf8-5e84111a2648 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bbb81453-3784-4f5f-894b-df2a2d1d7d9c,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:36.636139 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b95caa16-79ed-467d-8bf8-5e84111a2648 admin admin] Checking segment: {'id': 'fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1232, 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:17:36.636732 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b95caa16-79ed-467d-8bf8-5e84111a2648 admin admin] Network hostable DHCP agents. Network: 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103243) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:17:36.710181 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Publish callbacks [] for port, precommit_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:36.720777 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-32a58d3c-295a-4749-947e-2e9279e6199f req-99143f9a-c3ae-4037-a4ab-9fc99540886f service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1119242 Nov 24 11:17:36.727079 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b95caa16-79ed-467d-8bf8-5e84111a2648 admin admin] Network 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103243) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:17:36.730061 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [req-32a58d3c-295a-4749-947e-2e9279e6199f req-393b8cc8-7d28-4afa-bbb5-d8747147d62a service neutron] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:17:36.731019 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-32a58d3c-295a-4749-947e-2e9279e6199f req-393b8cc8-7d28-4afa-bbb5-d8747147d62a service neutron] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048587 Nov 24 11:17:36.812793 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:36.824451 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-b95caa16-79ed-467d-8bf8-5e84111a2648 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8) {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:17:36.831431 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b95caa16-79ed-467d-8bf8-5e84111a2648 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:36.831431 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-b95caa16-79ed-467d-8bf8-5e84111a2648 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:36.840816 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-14df954f-d826-492d-8906-eac1285427e5 None None] Network 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:17:36.914386 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 7041b264-1b4e-4b52-9407-c7681bd79d2b up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:17:36.915519 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-b95caa16-79ed-467d-8bf8-5e84111a2648 admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6908402 Nov 24 11:17:36.923227 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 57340) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:36.923227 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1938436293-router', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:17:36.951331 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2036f5c6-cbb3-45b1-af28-cbc58f5d3b30 None None] Pushing event updated for resources: {'Port': ['ID=3c193dd0-ad65-44b5-b059-da55dd5857b0,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:36.993531 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 0b6945a0-371d-4113-8209-5fa0406ef613 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:17:37.042060 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1010094', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.043576 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1009794', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-534758', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-985777', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-654'] for router, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.089744 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Attempting to bind port 3c193dd0-ad65-44b5-b059-da55dd5857b0 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:17:37.090122 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Attempting to bind port 3c193dd0-ad65-44b5-b059-da55dd5857b0 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:17:37.090474 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Attempting to bind port 3c193dd0-ad65-44b5-b059-da55dd5857b0 on network c3a531f2-bfe9-4a80-8b71-ad7f35944879 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:17:37.115113 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 17, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:17:37.115766 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Checking segment: {'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:17:37.116316 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.116565 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Bound using segment: {'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:17:37.117045 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Bound port: 3c193dd0-ad65-44b5-b059-da55dd5857b0, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:17:37.117732 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.134623 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.159533 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2957bab4-3e76-4677-8a78-b3bbd851d884 req-8ae0b85d-55c5-4deb-904c-594c28aac9bf tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:37.161083 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2957bab4-3e76-4677-8a78-b3bbd851d884 req-8ae0b85d-55c5-4deb-904c-594c28aac9bf tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 945 time: 0.0866804 Nov 24 11:17:37.175987 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 7041b264-1b4e-4b52-9407-c7681bd79d2b completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:17:37.183218 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 0b6945a0-371d-4113-8209-5fa0406ef613 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:37.183614 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.190598 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1e1181f3-c521-552f-a8c5-b0ec988a193c-005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8', 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'fixed_ips': [{'subnet_id': 'bbb81453-3784-4f5f-894b-df2a2d1d7d9c'}]}} from dv-cinder-804035-18-iscsi. {{(pid=103245) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 11:17:37.191484 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.201841 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 7041b264-1b4e-4b52-9407-c7681bd79d2b triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:37.202469 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.281200 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-5cb215bd-4c2b-45c3-9b8a-74c909031101 None None] Provisioning complete for port 3c193dd0-ad65-44b5-b059-da55dd5857b0 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:37.281860 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5cb215bd-4c2b-45c3-9b8a-74c909031101 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.331619 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] For port 3c193dd0-ad65-44b5-b059-da55dd5857b0, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:17:37.381285 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2957bab4-3e76-4677-8a78-b3bbd851d884 req-91ca48b4-d681-4282-87a0-f385da1bd2d8 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2122548 Nov 24 11:17:37.391726 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.407520 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] For port 3c193dd0-ad65-44b5-b059-da55dd5857b0, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=3c193dd0-ad65-44b5-b059-da55dd5857b0,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:17:37.419823 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c353b66-ebd0-4507-a890-cb927ad1857e req-a112421c-a029-4450-b379-d0d6b7b954b8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:37.430008 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2c353b66-ebd0-4507-a890-cb927ad1857e req-a112421c-a029-4450-b379-d0d6b7b954b8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.1626799 Nov 24 11:17:37.435763 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-5cb215bd-4c2b-45c3-9b8a-74c909031101 None None] Port 3c193dd0-ad65-44b5-b059-da55dd5857b0 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:17:37.487249 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2c353b66-ebd0-4507-a890-cb927ad1857e req-3ae4b578-ec4e-41dc-b327-eda9a40a873f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0563521 Nov 24 11:17:37.503097 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.548023 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e77a1e1a-a99c-427e-ae90-f9247a45c010 req-9751f13f-e0cb-4093-8663-74d4fa3b74cb tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:37.549570 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e77a1e1a-a99c-427e-ae90-f9247a45c010 req-9751f13f-e0cb-4093-8663-74d4fa3b74cb tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0856311 Nov 24 11:17:37.619111 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.626195 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.db_base_plugin_common [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Allocated IP 172.20.0.2 (005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8/bbb81453-3784-4f5f-894b-df2a2d1d7d9c/ca18f43d-c498-4734-82e7-7a402959f852) {{(pid=103245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:17:37.634217 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e77a1e1a-a99c-427e-ae90-f9247a45c010 req-d34548e1-4cac-4a3e-ac5f-6747a516ec74 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0778680 Nov 24 11:17:37.648782 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2036f5c6-cbb3-45b1-af28-cbc58f5d3b30 None None] Pushing event updated for resources: {'Port': ['ID=3c193dd0-ad65-44b5-b059-da55dd5857b0,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:37.661963 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Routers {'0d8adae3-0d48-4940-84b4-9800d498d230'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:17:37.661963 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:17:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['0d8adae3-0d48-4940-84b4-9800d498d230'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:37.747671 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16be8a18-2ef0-4454-952b-aaf5990c5ada', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7041b264-1b4e-4b52-9407-c7681bd79d2b'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:17:37.749836 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2bdc9417-008b-4aba-ba69-698b3af3123d" -d '{"events": [{"server_uuid": "16be8a18-2ef0-4454-952b-aaf5990c5ada", "name": "network-vif-plugged", "status": "completed", "tag": "7041b264-1b4e-4b52-9407-c7681bd79d2b"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:17:37.799711 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.824964 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:37.870702 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 7041b264-1b4e-4b52-9407-c7681bd79d2b, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=7041b264-1b4e-4b52-9407-c7681bd79d2b,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:37.872692 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:17:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60be5459-a298-4b03-9684-8035a7c526a5 x-openstack-request-id: req-60be5459-a298-4b03-9684-8035a7c526a5 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:17:37.872971 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16be8a18-2ef0-4454-952b-aaf5990c5ada", "name": "network-vif-plugged", "status": "completed", "tag": "7041b264-1b4e-4b52-9407-c7681bd79d2b", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:17:37.873220 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-60be5459-a298-4b03-9684-8035a7c526a5 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:17:37.873622 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16be8a18-2ef0-4454-952b-aaf5990c5ada', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7041b264-1b4e-4b52-9407-c7681bd79d2b', 'code': 200} Nov 24 11:17:37.947166 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Allocated IP 172.27.3.52 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/9e5c8471-8e07-4442-afbe-a820f59bc7fe) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:17:38.027834 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.028670 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:17:38.054690 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.132447 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] Set router 0d8adae3-0d48-4940-84b4-9800d498d230 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:17:38.135559 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-fdb79f6e-f4c7-49be-9528-92d7dd85fe64 None None] Provisioning complete for port 3c193dd0-ad65-44b5-b059-da55dd5857b0 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:38.135881 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fdb79f6e-f4c7-49be-9528-92d7dd85fe64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.151790 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4260e2be-8e77-4b7b-9bf9-746bad98bf1c req-6ce1eaa6-99dd-45bc-9732-8326d3b3689b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:38.153377 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4260e2be-8e77-4b7b-9bf9-746bad98bf1c req-6ce1eaa6-99dd-45bc-9732-8326d3b3689b service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 1099 time: 0.0468533 Nov 24 11:17:38.162123 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.200528 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4260e2be-8e77-4b7b-9bf9-746bad98bf1c req-93cbd23b-6cdb-4f6e-ac41-85d9cb9114cc service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388756 Nov 24 11:17:38.206859 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:17:38.212375 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:17:38.214847 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:17:38.217839 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Publish callbacks [] for port, precommit_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.239028 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Pushing event updated for resources: {'Port': ['ID=9e5c8471-8e07-4442-afbe-a820f59bc7fe,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:38.274979 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=7041b264-1b4e-4b52-9407-c7681bd79d2b,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:38.318318 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.419274 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Network 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 is already hosted by enough agents. {{(pid=103245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:17:38.450249 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.base_scheduler [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Resources bound (agent type, host, resource id): {{(pid=103245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:17:38.455633 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Received port after_create {{(pid=103245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:17:38.459155 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Pushing event updated for resources: {'Port': ['ID=ca18f43d-c498-4734-82e7-7a402959f852,revision_number=1']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:38.504832 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fdb79f6e-f4c7-49be-9528-92d7dd85fe64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.558080 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06837bee-278e-4de4-8127-e35ef685db03 req-e7981f04-a337-4591-ab7a-9d1ce02e03bb tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:38.560182 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-06837bee-278e-4de4-8127-e35ef685db03 req-e7981f04-a337-4591-ab7a-9d1ce02e03bb tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 946 time: 0.0993032 Nov 24 11:17:38.581787 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Attempting to bind port ca18f43d-c498-4734-82e7-7a402959f852 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:17:38.582157 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Attempting to bind port ca18f43d-c498-4734-82e7-7a402959f852 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1232, 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:17:38.582517 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Attempting to bind port ca18f43d-c498-4734-82e7-7a402959f852 on network 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:17:38.598236 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-fdb79f6e-f4c7-49be-9528-92d7dd85fe64 None None] For port 3c193dd0-ad65-44b5-b059-da55dd5857b0, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=3c193dd0-ad65-44b5-b059-da55dd5857b0,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:38.602223 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 17, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:17:38.602599 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Checking segment: {'id': 'fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1232, 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:17:38.602996 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.603415 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Bound using segment: {'id': 'fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1232, 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:17:38.603886 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Bound port: ca18f43d-c498-4734-82e7-7a402959f852, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1232, 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:17:38.604262 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.660686 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:17:33Z', 'revision_number': 4, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3c193dd0-ad65-44b5-b059-da55dd5857b0', 'name': '', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'mac_address': 'fa:16:3e:0f:1e:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:33Z', 'updated_at': '2021-11-24T11:17:37Z', 'revision_number': 4, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'subnets': [{'id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:38.685173 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.709643 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6fc907b4-902a-40ce-9e5c-e2dbc80d8a67 None None] The sync data for ids ['0d8adae3-0d48-4940-84b4-9800d498d230'] in dv-cinder-804035-18-iscsi is: [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:17:33Z', 'revision_number': 4, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3c193dd0-ad65-44b5-b059-da55dd5857b0', 'name': '', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'mac_address': 'fa:16:3e:0f:1e:65', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:33Z', 'updated_at': '2021-11-24T11:17:37Z', 'revision_number': 4, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'subnets': [{'id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:17:38.721956 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fdb79f6e-f4c7-49be-9528-92d7dd85fe64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.723329 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-06837bee-278e-4de4-8127-e35ef685db03 req-8fdebd6a-5bbd-4083-b4f0-f6a2034de771 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1317356 Nov 24 11:17:38.745159 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd35038b-bad6-4ec4-a990-a9641c93b96f req-18fe5578-a5c2-4564-95a3-7afb8b2c2389 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:38.745159 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd35038b-bad6-4ec4-a990-a9641c93b96f req-18fe5578-a5c2-4564-95a3-7afb8b2c2389 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.1527841 Nov 24 11:17:38.770541 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] For port ca18f43d-c498-4734-82e7-7a402959f852, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:17:38.798991 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] For port ca18f43d-c498-4734-82e7-7a402959f852, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=ca18f43d-c498-4734-82e7-7a402959f852,segment=NetworkSegment(fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3),segment_id=fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:17:38.823909 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdb79f6e-f4c7-49be-9528-92d7dd85fe64 None None] Pushing event updated for resources: {'Port': ['ID=3c193dd0-ad65-44b5-b059-da55dd5857b0,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:38.830016 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-ee54b230-7e7a-467e-9221-b8e57acec367 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.865424 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:38.934958 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3ee28b2-2f6b-4417-96b7-f171af19b943 None None] Pushing event updated for resources: {'Port': ['ID=ca18f43d-c498-4734-82e7-7a402959f852,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:39.061155 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 3c193dd0-ad65-44b5-b059-da55dd5857b0 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:17:39.140583 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 3c193dd0-ad65-44b5-b059-da55dd5857b0 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:39.141124 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:39.187848 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:39.281999 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd35038b-bad6-4ec4-a990-a9641c93b96f req-452a8f1e-0219-498b-8d20-af9b6bfb81ca tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5024660 Nov 24 11:17:39.321976 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-546263d6-f16d-42a7-a247-4a7f555df331 req-f0b260df-f85f-4ee0-9b84-a4f3c6b31e86 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:39.330528 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-546263d6-f16d-42a7-a247-4a7f555df331 req-f0b260df-f85f-4ee0-9b84-a4f3c6b31e86 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.2375445 Nov 24 11:17:39.346546 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1009813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-942685'] for router, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:39.431403 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-546263d6-f16d-42a7-a247-4a7f555df331 req-c6945f14-199b-4b22-87a1-68a23b79bee1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0998778 Nov 24 11:17:39.578965 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Router da3d2828-5da1-45d7-82a4-de474b0ce982 is scheduled to L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 with binding_index 1 {{(pid=103244) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 11:17:39.699665 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:17:39.710642 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Sync routers for ids ['da3d2828-5da1-45d7-82a4-de474b0ce982'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:17:39.721871 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Routers {'da3d2828-5da1-45d7-82a4-de474b0ce982'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:17:39.722570 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:17:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['da3d2828-5da1-45d7-82a4-de474b0ce982'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:39.803889 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] Publish callbacks [] for router, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:39.805687 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-1312ff55-3649-426c-8686-177507a2167b admin admin] 10.222.0.76 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 2.8861115 Nov 24 11:17:39.808383 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 57360) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:17:39.874011 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Set router da3d2828-5da1-45d7-82a4-de474b0ce982 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:17:39.899317 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a58d3c-295a-4749-947e-2e9279e6199f req-fff6ecd2-91d2-4826-8cc8-8d03689584fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:39.900978 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-32a58d3c-295a-4749-947e-2e9279e6199f req-fff6ecd2-91d2-4826-8cc8-8d03689584fc service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1&tenant_id=70ea7b83799640618db2c87847a8ecea HTTP/1.1" status: 200 len: 1097 time: 0.1534188 Nov 24 11:17:39.979890 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5de39ea9-50cb-4c6a-8cd3-153ad34bcfb4 req-05bc001a-1ffa-4ab5-9733-0256b790a3ac tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:39.981444 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5de39ea9-50cb-4c6a-8cd3-153ad34bcfb4 req-05bc001a-1ffa-4ab5-9733-0256b790a3ac tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 946 time: 0.1132445 Nov 24 11:17:39.993533 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a58d3c-295a-4749-947e-2e9279e6199f req-ae4cd39b-dbff-445a-a64b-2751684c5715 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:39.995232 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-32a58d3c-295a-4749-947e-2e9279e6199f req-ae4cd39b-dbff-445a-a64b-2751684c5715 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 1097 time: 0.0682909 Nov 24 11:17:40.112111 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5de39ea9-50cb-4c6a-8cd3-153ad34bcfb4 req-caa7d6e0-97c7-43e6-a883-1b0e46c15df0 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1178794 Nov 24 11:17:40.136225 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a58d3c-295a-4749-947e-2e9279e6199f req-8c745224-d697-4c55-bc17-652e7ba58568 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:40.140036 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-32a58d3c-295a-4749-947e-2e9279e6199f req-8c745224-d697-4c55-bc17-652e7ba58568 service neutron] 10.222.0.86 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 919 time: 0.1319346 Nov 24 11:17:40.189214 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'name': 'tempest-TestMinimumBasicScenario-1938436293-router', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:38Z', 'revision_number': 3, 'project_id': 'c0d223d26f5146fc9e583ac067c520d4', 'gw_port': {'id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:4b:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:40.229797 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Checking router: da3d2828-5da1-45d7-82a4-de474b0ce982 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:17:40.230157 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Updating router da3d2828-5da1-45d7-82a4-de474b0ce982 port 9e5c8471-8e07-4442-afbe-a820f59bc7fe binding host dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:17:40.247888 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9c89fffe-cbf0-4a5e-a310-cb56c32b4e9e None None] Network 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:17:40.251415 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-32a58d3c-295a-4749-947e-2e9279e6199f req-dd34a840-e6cc-4ca1-81e6-a748917b9642 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 HTTP/1.1" status: 200 len: 1000 time: 0.0989034 Nov 24 11:17:40.300797 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:40.336941 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a58d3c-295a-4749-947e-2e9279e6199f req-86f1492b-96f6-4c33-a0f3-45c91bb91ea6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:40.339864 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-32a58d3c-295a-4749-947e-2e9279e6199f req-86f1492b-96f6-4c33-a0f3-45c91bb91ea6 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=5eae2e87-935a-45b7-89da-586ce04ad644 HTTP/1.1" status: 200 len: 856 time: 0.0757265 Nov 24 11:17:40.342390 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-62944aa7-7de9-4d96-be05-97d33b79b11d None None] Provisioning complete for port ca18f43d-c498-4734-82e7-7a402959f852 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:40.342832 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-62944aa7-7de9-4d96-be05-97d33b79b11d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:40.398244 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a58d3c-295a-4749-947e-2e9279e6199f req-8f09d84b-aec3-4a76-8434-fac6a2134477 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:40.400958 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-32a58d3c-295a-4749-947e-2e9279e6199f req-8f09d84b-aec3-4a76-8434-fac6a2134477 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=76fcee22-81e5-4608-a546-3b68c56c5ac7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0538476 Nov 24 11:17:40.500120 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:40.534720 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-32a58d3c-295a-4749-947e-2e9279e6199f req-9b775470-38c8-4636-9e15-f819359f140a service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1203842 Nov 24 11:17:40.544838 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc9e5b2d-b7b9-4e30-9c58-a7d9a731eb0a req-0b218e15-ea34-4b96-8b39-c7fe37518838 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:40.546447 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bc9e5b2d-b7b9-4e30-9c58-a7d9a731eb0a req-0b218e15-ea34-4b96-8b39-c7fe37518838 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.1347401 Nov 24 11:17:40.610854 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-62944aa7-7de9-4d96-be05-97d33b79b11d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:40.660189 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-62944aa7-7de9-4d96-be05-97d33b79b11d None None] For port ca18f43d-c498-4734-82e7-7a402959f852, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=ca18f43d-c498-4734-82e7-7a402959f852,segment=NetworkSegment(fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3),segment_id=fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:40.706733 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-32a58d3c-295a-4749-947e-2e9279e6199f req-83f5136b-5068-4230-bbf7-840249352baf service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1613650 Nov 24 11:17:40.745238 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-62944aa7-7de9-4d96-be05-97d33b79b11d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:40.769163 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a005b035-89ab-4ddf-ab73-a1c1c6594a21 req-49b655f9-161f-446f-b078-0f93a4e05f1c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:40.771013 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a005b035-89ab-4ddf-ab73-a1c1c6594a21 req-49b655f9-161f-446f-b078-0f93a4e05f1c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.1710596 Nov 24 11:17:40.837197 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Publish callbacks [] for port, precommit_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:40.855335 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62944aa7-7de9-4d96-be05-97d33b79b11d None None] Pushing event updated for resources: {'Port': ['ID=ca18f43d-c498-4734-82e7-7a402959f852,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:40.878271 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bc9e5b2d-b7b9-4e30-9c58-a7d9a731eb0a req-4c30d931-7437-4e03-a659-e76f652ee882 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3115249 Nov 24 11:17:40.915511 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:40.968703 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Allocated IP 172.20.0.1 (005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8/bbb81453-3784-4f5f-894b-df2a2d1d7d9c/f51f8128-1b30-41e7-8ef8-25605ddf1809) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:17:40.973850 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a005b035-89ab-4ddf-ab73-a1c1c6594a21 req-d78305b4-05a3-4504-b1d0-bae6792b23fa tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1931183 Nov 24 11:17:40.999875 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-3115119c-2160-43ba-b3a3-5e16ce443fed None None] Provisioning complete for port ca18f43d-c498-4734-82e7-7a402959f852 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:41.000878 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-3115119c-2160-43ba-b3a3-5e16ce443fed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:41.004537 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Attempting to bind port 9e5c8471-8e07-4442-afbe-a820f59bc7fe on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:17:41.005685 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Attempting to bind port 9e5c8471-8e07-4442-afbe-a820f59bc7fe by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:17:41.006937 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Attempting to bind port 9e5c8471-8e07-4442-afbe-a820f59bc7fe on network fa6231d1-a629-42bc-a091-20035dee3542 {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:17:41.020031 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 17, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:17:41.020409 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Checking segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:17:41.020809 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:41.021197 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Bound using segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:17:41.022195 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Bound port: 9e5c8471-8e07-4442-afbe-a820f59bc7fe, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:17:41.022594 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:41.025114 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30862efc-2d70-4443-8d44-1d8a1d15765b None None] Pushing event updated for resources: {'Port': ['ID=9e5c8471-8e07-4442-afbe-a820f59bc7fe,revision_number=2']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:41.126122 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:41.128522 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] For port 9e5c8471-8e07-4442-afbe-a820f59bc7fe, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:17:41.133494 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] For port 9e5c8471-8e07-4442-afbe-a820f59bc7fe, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9e5c8471-8e07-4442-afbe-a820f59bc7fe,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:17:41.139837 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device ca18f43d-c498-4734-82e7-7a402959f852 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:17:41.172103 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-856fea6a-00c8-4ae5-996e-b52c56ac376a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:41.197628 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port ca18f43d-c498-4734-82e7-7a402959f852 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:41.203590 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:41.213769 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:41.231678 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:41.281097 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Routers {'da3d2828-5da1-45d7-82a4-de474b0ce982'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:17:41.281377 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Network 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:17:41.281898 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:17:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['da3d2828-5da1-45d7-82a4-de474b0ce982'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:41.287881 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30862efc-2d70-4443-8d44-1d8a1d15765b None None] Pushing event updated for resources: {'Port': ['ID=9e5c8471-8e07-4442-afbe-a820f59bc7fe,revision_number=3']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:41.289413 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:17:41.292988 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:17:41.317994 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Pushing event updated for resources: {'Port': ['ID=f51f8128-1b30-41e7-8ef8-25605ddf1809,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:41.343077 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1009482'] for router_interface, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:41.429952 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] Set router da3d2828-5da1-45d7-82a4-de474b0ce982 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:17:41.591139 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-abdba1c0-a4fb-486e-a7f3-1962d5c98481 None None] Provisioning complete for port f51f8128-1b30-41e7-8ef8-25605ddf1809 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:41.592357 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-abdba1c0-a4fb-486e-a7f3-1962d5c98481 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:41.634436 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-abdba1c0-a4fb-486e-a7f3-1962d5c98481 None None] Port f51f8128-1b30-41e7-8ef8-25605ddf1809 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:17:41.645989 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:41.689341 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'name': 'tempest-TestMinimumBasicScenario-1938436293-router', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:38Z', 'revision_number': 3, 'project_id': 'c0d223d26f5146fc9e583ac067c520d4', 'gw_port': {'id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:4b:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:41.723467 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9bb49e7-61e5-4eba-840b-c08bde30ab52 None None] The sync data for ids ['da3d2828-5da1-45d7-82a4-de474b0ce982'] in dv-cinder-804035-18-iscsi is: [{'id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'name': 'tempest-TestMinimumBasicScenario-1938436293-router', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:38Z', 'revision_number': 3, 'project_id': 'c0d223d26f5146fc9e583ac067c520d4', 'gw_port': {'id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:4b:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:17:41.898841 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:42.000434 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8699083'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:42.096443 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-636370', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1009638'] for router_interface, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:42.114796 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Pushing event updated for resources: {'Port': ['ID=f51f8128-1b30-41e7-8ef8-25605ddf1809,revision_number=2']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:42.129997 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-192232de-0f45-45d4-8066-bea5234ec3a4 req-479ab657-6c65-42eb-86e9-1c3760c95f81 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:42.132390 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-192232de-0f45-45d4-8066-bea5234ec3a4 req-479ab657-6c65-42eb-86e9-1c3760c95f81 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.1638727 Nov 24 11:17:42.242798 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-192232de-0f45-45d4-8066-bea5234ec3a4 req-13723ae6-d4e1-4d9f-8d35-a49bedd56a04 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0957773 Nov 24 11:17:42.292097 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Network 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:17:42.293557 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:17:42.418769 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:42.666901 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-7ef54b1b-3ad9-477f-ac84-d663f2a9bea7 None None] Provisioning complete for port f51f8128-1b30-41e7-8ef8-25605ddf1809 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:42.668784 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-7ef54b1b-3ad9-477f-ac84-d663f2a9bea7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:42.729526 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-7ef54b1b-3ad9-477f-ac84-d663f2a9bea7 None None] Port f51f8128-1b30-41e7-8ef8-25605ddf1809 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:17:42.741136 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06e1a443-2262-4041-8a05-d07531584cf6 req-46d78e3c-e24c-4219-ba53-ec0b4c281a59 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:42.742680 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-06e1a443-2262-4041-8a05-d07531584cf6 req-46d78e3c-e24c-4219-ba53-ec0b4c281a59 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.1261580 Nov 24 11:17:42.764368 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Router da3d2828-5da1-45d7-82a4-de474b0ce982 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:17:42.873775 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-06e1a443-2262-4041-8a05-d07531584cf6 req-1283200e-3b13-43aa-b2f1-964d61ae5efe tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1214683 Nov 24 11:17:42.954059 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:17:42.963967 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-b7c34be5-5a9c-44ed-9f89-73e9980a47c3 admin admin] 10.222.0.76 "PUT /v2.0/routers/da3d2828-5da1-45d7-82a4-de474b0ce982/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.1541767 Nov 24 11:17:43.028786 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9e5c8471-8e07-4442-afbe-a820f59bc7fe up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:17:43.084645 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 9e5c8471-8e07-4442-afbe-a820f59bc7fe triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:43.085571 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:43.189475 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:43.355337 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] For port 9e5c8471-8e07-4442-afbe-a820f59bc7fe, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9e5c8471-8e07-4442-afbe-a820f59bc7fe,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:43.418426 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b76a6e2-ea0e-47ed-8368-9a8be54df323 req-7450c27b-0495-4e88-a149-62ccccfff778 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:43.420051 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7b76a6e2-ea0e-47ed-8368-9a8be54df323 req-7450c27b-0495-4e88-a149-62ccccfff778 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0568328 Nov 24 11:17:43.436069 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:43.506270 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Pushing event updated for resources: {'Port': ['ID=9e5c8471-8e07-4442-afbe-a820f59bc7fe,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:43.513484 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7b76a6e2-ea0e-47ed-8368-9a8be54df323 req-efd9cccd-5563-487a-853e-a54e32674317 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0866642 Nov 24 11:17:43.811897 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Sync routers for ids ['da3d2828-5da1-45d7-82a4-de474b0ce982'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:17:43.826001 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Routers {'da3d2828-5da1-45d7-82a4-de474b0ce982'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:17:43.826707 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:17:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['da3d2828-5da1-45d7-82a4-de474b0ce982'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:43.951971 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Set router da3d2828-5da1-45d7-82a4-de474b0ce982 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:17:44.070052 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afc9e856-cd36-4abd-a505-882a10f6ff8e req-b2ae5349-9754-4ec2-9406-9057b1e22ee4 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:44.075429 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-afc9e856-cd36-4abd-a505-882a10f6ff8e req-b2ae5349-9754-4ec2-9406-9057b1e22ee4 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0800464 Nov 24 11:17:44.243397 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-afc9e856-cd36-4abd-a505-882a10f6ff8e req-e6b9abc8-07bf-465c-a625-bb1fe2288aab tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715220 Nov 24 11:17:44.267201 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'name': 'tempest-TestMinimumBasicScenario-1938436293-router', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:41Z', 'revision_number': 4, 'project_id': 'c0d223d26f5146fc9e583ac067c520d4', 'gw_port': {'id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:4b:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': 'f51f8128-1b30-41e7-8ef8-25605ddf1809', 'name': '', 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'mac_address': 'fa:16:3e:7e:e2:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': 'bbb81453-3784-4f5f-894b-df2a2d1d7d9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:40Z', 'updated_at': '2021-11-24T11:17:41Z', 'revision_number': 2, 'project_id': 'c0d223d26f5146fc9e583ac067c520d4', 'subnets': [{'id': 'bbb81453-3784-4f5f-894b-df2a2d1d7d9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:44.309402 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Checking router: da3d2828-5da1-45d7-82a4-de474b0ce982 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:17:44.310178 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Updating router da3d2828-5da1-45d7-82a4-de474b0ce982 port f51f8128-1b30-41e7-8ef8-25605ddf1809 binding host dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:17:44.340913 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:44.673906 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef766f81-3f25-49f7-bbb7-6db3864047b3 req-55081950-1b9b-43b8-8d58-df0c77aac86e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:44.708447 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ef766f81-3f25-49f7-bbb7-6db3864047b3 req-55081950-1b9b-43b8-8d58-df0c77aac86e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0753014 Nov 24 11:17:44.708601 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:44.766033 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Publish callbacks [] for port, precommit_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:44.780920 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ef766f81-3f25-49f7-bbb7-6db3864047b3 req-50d42bd2-72ef-4b73-83a0-ef03d44a1c54 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0961969 Nov 24 11:17:45.027708 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9e5c8471-8e07-4442-afbe-a820f59bc7fe up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:17:45.107163 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 9e5c8471-8e07-4442-afbe-a820f59bc7fe triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:45.107565 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:45.369812 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863bcfce-e4cb-40a9-91d5-49a675a13e69 req-c643094b-a738-442f-a9b1-fd8cd52bbc3c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:45.371314 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-863bcfce-e4cb-40a9-91d5-49a675a13e69 req-c643094b-a738-442f-a9b1-fd8cd52bbc3c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0649354 Nov 24 11:17:45.413509 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:45.416735 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:45.451221 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-863bcfce-e4cb-40a9-91d5-49a675a13e69 req-295ba2db-7655-4de8-b0e4-8eccd81e56b5 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723588 Nov 24 11:17:45.480368 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5310c1d-8843-42ee-8d1d-c954a5a84ea3 None None] Pushing event updated for resources: {'Port': ['ID=f51f8128-1b30-41e7-8ef8-25605ddf1809,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:45.602532 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Attempting to bind port f51f8128-1b30-41e7-8ef8-25605ddf1809 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:17:45.602739 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Attempting to bind port f51f8128-1b30-41e7-8ef8-25605ddf1809 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1232, 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:17:45.603421 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Attempting to bind port f51f8128-1b30-41e7-8ef8-25605ddf1809 on network 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:17:45.609344 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 17, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:17:45.609714 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Checking segment: {'id': 'fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1232, 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:17:45.610114 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:45.610504 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Bound using segment: {'id': 'fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1232, 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:17:45.610976 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Bound port: f51f8128-1b30-41e7-8ef8-25605ddf1809, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1232, 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:17:45.611388 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:45.740577 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] For port f51f8128-1b30-41e7-8ef8-25605ddf1809, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:17:45.749341 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] For port f51f8128-1b30-41e7-8ef8-25605ddf1809, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=f51f8128-1b30-41e7-8ef8-25605ddf1809,segment=NetworkSegment(fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3),segment_id=fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:17:45.848066 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:45.999030 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c607e91-1348-4b01-80fd-949ca5541fdd req-3ae61d42-036d-44b4-a915-121f91cd077e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:46.000629 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Routers {'da3d2828-5da1-45d7-82a4-de474b0ce982'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:17:46.001750 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:17:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['da3d2828-5da1-45d7-82a4-de474b0ce982'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:46.008660 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9c607e91-1348-4b01-80fd-949ca5541fdd req-3ae61d42-036d-44b4-a915-121f91cd077e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0783212 Nov 24 11:17:46.071705 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9c607e91-1348-4b01-80fd-949ca5541fdd req-b28af200-aab6-4698-9bb4-0f2891b551e9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0567648 Nov 24 11:17:46.175595 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-8a5d0e09-53bb-4f0c-a50c-7b65beaa4e06 None None] Provisioning complete for port f51f8128-1b30-41e7-8ef8-25605ddf1809 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:46.175595 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-8a5d0e09-53bb-4f0c-a50c-7b65beaa4e06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:46.221952 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] Set router da3d2828-5da1-45d7-82a4-de474b0ce982 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:17:46.225192 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5310c1d-8843-42ee-8d1d-c954a5a84ea3 None None] Pushing event updated for resources: {'Port': ['ID=f51f8128-1b30-41e7-8ef8-25605ddf1809,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:46.481495 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-8a5d0e09-53bb-4f0c-a50c-7b65beaa4e06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:46.543364 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-8a5d0e09-53bb-4f0c-a50c-7b65beaa4e06 None None] For port f51f8128-1b30-41e7-8ef8-25605ddf1809, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=f51f8128-1b30-41e7-8ef8-25605ddf1809,segment=NetworkSegment(fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3),segment_id=fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:17:46.566540 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'name': 'tempest-TestMinimumBasicScenario-1938436293-router', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:41Z', 'revision_number': 4, 'project_id': 'c0d223d26f5146fc9e583ac067c520d4', 'gw_port': {'id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:4b:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': 'f51f8128-1b30-41e7-8ef8-25605ddf1809', 'name': '', 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'mac_address': 'fa:16:3e:7e:e2:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': 'bbb81453-3784-4f5f-894b-df2a2d1d7d9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:40Z', 'updated_at': '2021-11-24T11:17:45Z', 'revision_number': 4, 'project_id': 'c0d223d26f5146fc9e583ac067c520d4', 'subnets': [{'id': 'bbb81453-3784-4f5f-894b-df2a2d1d7d9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:17:46.609518 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f41e65bb-1471-41d4-9e13-548bb70de2b9 None None] The sync data for ids ['da3d2828-5da1-45d7-82a4-de474b0ce982'] in dv-cinder-804035-18-iscsi is: [{'id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'name': 'tempest-TestMinimumBasicScenario-1938436293-router', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:41Z', 'revision_number': 4, 'project_id': 'c0d223d26f5146fc9e583ac067c520d4', 'gw_port': {'id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:4b:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': 'f51f8128-1b30-41e7-8ef8-25605ddf1809', 'name': '', 'network_id': '005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'mac_address': 'fa:16:3e:7e:e2:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': 'bbb81453-3784-4f5f-894b-df2a2d1d7d9c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:40Z', 'updated_at': '2021-11-24T11:17:45Z', 'revision_number': 4, 'project_id': 'c0d223d26f5146fc9e583ac067c520d4', 'subnets': [{'id': 'bbb81453-3784-4f5f-894b-df2a2d1d7d9c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:17:46.623943 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-8a5d0e09-53bb-4f0c-a50c-7b65beaa4e06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:46.700485 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0342e75-d2c4-4f5d-97cb-37c39ae9d08f req-fdc65248-1409-47b6-9aa7-a40b25698161 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:46.719886 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b0342e75-d2c4-4f5d-97cb-37c39ae9d08f req-fdc65248-1409-47b6-9aa7-a40b25698161 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.1230953 Nov 24 11:17:46.807155 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a5d0e09-53bb-4f0c-a50c-7b65beaa4e06 None None] Pushing event updated for resources: {'Port': ['ID=f51f8128-1b30-41e7-8ef8-25605ddf1809,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:17:46.826106 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-7b0f0300-6c98-4c30-afa2-f8ee5cc3b723 None None] Provisioning complete for port f51f8128-1b30-41e7-8ef8-25605ddf1809 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:46.826485 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-7b0f0300-6c98-4c30-afa2-f8ee5cc3b723 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:46.835221 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b0342e75-d2c4-4f5d-97cb-37c39ae9d08f req-14daec02-0499-453f-a660-3c1bece9ca69 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1143084 Nov 24 11:17:47.081759 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device f51f8128-1b30-41e7-8ef8-25605ddf1809 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:17:47.210118 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port f51f8128-1b30-41e7-8ef8-25605ddf1809 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:17:47.210825 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:17:47.485137 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e6526d0-945e-4bd1-a8e1-beb4261d8312 req-5fe1947e-ef82-4029-a9a2-56e88fa6b475 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:47.485137 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4e6526d0-945e-4bd1-a8e1-beb4261d8312 req-5fe1947e-ef82-4029-a9a2-56e88fa6b475 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.1827359 Nov 24 11:17:47.485137 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4e6526d0-945e-4bd1-a8e1-beb4261d8312 req-3f375e90-3fc9-48d6-b74f-85d160627088 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0532386 Nov 24 11:17:47.966797 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d960b57c-0717-4ccd-86c9-45b23c3861d8 req-1ec6adc7-02c6-4735-ae02-e95bbd16a329 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:47.968347 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d960b57c-0717-4ccd-86c9-45b23c3861d8 req-1ec6adc7-02c6-4735-ae02-e95bbd16a329 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0503154 Nov 24 11:17:48.018163 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d960b57c-0717-4ccd-86c9-45b23c3861d8 req-e2dd158c-3e94-4263-9d6b-f8189c04128b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427473 Nov 24 11:17:48.624046 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6212f7-0109-49ff-ab83-705c58a1bf78 req-10b28aa0-c423-4fa0-93c9-2e1522d9ab71 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:48.638259 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bc6212f7-0109-49ff-ab83-705c58a1bf78 req-10b28aa0-c423-4fa0-93c9-2e1522d9ab71 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0945675 Nov 24 11:17:48.788209 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bc6212f7-0109-49ff-ab83-705c58a1bf78 req-198bc0e6-a09a-4aca-8e67-3e42dfdad6f0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1467950 Nov 24 11:17:49.188620 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c4ac618-eccb-471a-98b4-33cc5e0d1ec0 req-7721764a-22dc-41f2-ae8d-5fd7d23248da tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:49.190165 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8c4ac618-eccb-471a-98b4-33cc5e0d1ec0 req-7721764a-22dc-41f2-ae8d-5fd7d23248da tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0846362 Nov 24 11:17:49.261093 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8c4ac618-eccb-471a-98b4-33cc5e0d1ec0 req-fc3abcc0-a67c-4cdb-b4b4-07d42dd19ef5 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0633399 Nov 24 11:17:49.969905 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-470a70e5-3abd-4922-a359-ca30bca6114c req-bd0ef2ba-f8f8-4238-9831-c00340289d2e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:49.971474 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-470a70e5-3abd-4922-a359-ca30bca6114c req-bd0ef2ba-f8f8-4238-9831-c00340289d2e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0871484 Nov 24 11:17:50.030018 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-470a70e5-3abd-4922-a359-ca30bca6114c req-2d69bcc5-76ae-4e47-8ef6-05bc08144483 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517838 Nov 24 11:17:50.417356 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72ef355c-3bee-47bd-8f19-34af204b1e58 req-52329a0e-0a98-4dd0-9bc0-20112350b851 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:50.447666 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-72ef355c-3bee-47bd-8f19-34af204b1e58 req-52329a0e-0a98-4dd0-9bc0-20112350b851 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0693531 Nov 24 11:17:50.522889 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-72ef355c-3bee-47bd-8f19-34af204b1e58 req-750ef55b-37c9-47b6-8bf0-e7cfdff9b3aa tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0966339 Nov 24 11:17:51.183129 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a59bbb7f-bcb5-4d1a-a174-829b5610a480 req-e4ec4e20-04c7-48a9-abb8-ef9676c22c0a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:51.184652 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a59bbb7f-bcb5-4d1a-a174-829b5610a480 req-e4ec4e20-04c7-48a9-abb8-ef9676c22c0a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0532405 Nov 24 11:17:51.234950 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a59bbb7f-bcb5-4d1a-a174-829b5610a480 req-81e691b7-5eaf-4467-8b62-608359dd57c0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444825 Nov 24 11:17:51.643580 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a9d986-b4d8-49a2-9c41-2ad960f3af41 req-62ef40ec-d0f6-410b-9d53-7acdeaf6374e tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:51.645309 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-47a9d986-b4d8-49a2-9c41-2ad960f3af41 req-62ef40ec-d0f6-410b-9d53-7acdeaf6374e tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0583591 Nov 24 11:17:51.698053 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-47a9d986-b4d8-49a2-9c41-2ad960f3af41 req-bd6aa0ac-f73f-420c-87c8-3b61c847d90b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453076 Nov 24 11:17:52.437590 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c94e8e22-1410-4a81-9612-730160126de4 req-9d16145c-bea2-4900-bc3d-a13977fa5629 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:52.439558 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c94e8e22-1410-4a81-9612-730160126de4 req-9d16145c-bea2-4900-bc3d-a13977fa5629 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0755618 Nov 24 11:17:52.502577 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c94e8e22-1410-4a81-9612-730160126de4 req-6c27d031-972d-4700-9223-2b3f3ff5defc tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566556 Nov 24 11:17:52.875181 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7287dd-3b92-491b-a09a-b1f05ed64805 req-40e8ddc2-aeda-44d1-9984-121be76adb32 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:52.884176 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0e7287dd-3b92-491b-a09a-b1f05ed64805 req-40e8ddc2-aeda-44d1-9984-121be76adb32 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0733292 Nov 24 11:17:52.946750 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0e7287dd-3b92-491b-a09a-b1f05ed64805 req-6c857939-96ac-47f0-9467-b6e9887953aa tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0615542 Nov 24 11:17:53.672230 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd30473d-b3e2-4579-89a5-85b8c0cbcd64 req-942bef59-4da8-4984-9cb4-eeb585b34397 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:53.682898 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd30473d-b3e2-4579-89a5-85b8c0cbcd64 req-942bef59-4da8-4984-9cb4-eeb585b34397 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0877419 Nov 24 11:17:53.757636 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd30473d-b3e2-4579-89a5-85b8c0cbcd64 req-fdbc8a62-5424-42fe-8580-edbc10689613 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0684130 Nov 24 11:17:54.137734 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13f631cf-f055-425f-a89f-1fcefe983f87 req-45e3ffaf-e5d5-4709-8945-f023219d1697 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:54.144846 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-13f631cf-f055-425f-a89f-1fcefe983f87 req-45e3ffaf-e5d5-4709-8945-f023219d1697 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0758762 Nov 24 11:17:54.235030 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-13f631cf-f055-425f-a89f-1fcefe983f87 req-d148ba06-5e6b-441d-8ca3-6f50a58f3ff2 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0881777 Nov 24 11:17:54.874118 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05010c6-55a4-471b-831c-04666f49035e req-a65ee593-259c-4834-8b98-ff689091ef97 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:54.875613 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f05010c6-55a4-471b-831c-04666f49035e req-a65ee593-259c-4834-8b98-ff689091ef97 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0505118 Nov 24 11:17:54.929977 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f05010c6-55a4-471b-831c-04666f49035e req-c0398d6b-6c35-48e5-a6bd-48a4f7c619ea tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480964 Nov 24 11:17:55.360199 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8445c881-e02e-4dae-9efe-676384a76b3e req-76469c59-8da1-4a08-8c8d-f6757d4f3ca1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:55.361812 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8445c881-e02e-4dae-9efe-676384a76b3e req-76469c59-8da1-4a08-8c8d-f6757d4f3ca1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0556576 Nov 24 11:17:55.414733 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8445c881-e02e-4dae-9efe-676384a76b3e req-043627e0-abaa-46ef-8cb1-2ee3d12bb6c0 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448949 Nov 24 11:17:55.485992 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c37ff239-611b-4968-b2b1-b7b8328e32de req-34e1610d-2892-4298-be0e-0d031956fce6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:55.487526 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c37ff239-611b-4968-b2b1-b7b8328e32de req-34e1610d-2892-4298-be0e-0d031956fce6 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 1099 time: 0.0485241 Nov 24 11:17:55.534834 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c37ff239-611b-4968-b2b1-b7b8328e32de req-a29c5d4e-fdef-4169-9321-9cda0bead322 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0366368 Nov 24 11:17:56.060431 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-183b492b-308f-4d6a-a683-7417780147f5 req-01d7f70d-4eff-4aa1-a8a0-e4ccbdeaea2a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:56.061867 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-183b492b-308f-4d6a-a683-7417780147f5 req-01d7f70d-4eff-4aa1-a8a0-e4ccbdeaea2a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0487943 Nov 24 11:17:56.110499 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-183b492b-308f-4d6a-a683-7417780147f5 req-7c6b853b-0356-4381-8be8-23e12868ce36 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425398 Nov 24 11:17:56.535517 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f76dad-462e-4d95-9e7e-9ea25d18080c req-f970f83b-02e3-4d25-ad57-9e4b067726c1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:56.536987 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-92f76dad-462e-4d95-9e7e-9ea25d18080c req-f970f83b-02e3-4d25-ad57-9e4b067726c1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0529189 Nov 24 11:17:56.585712 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-92f76dad-462e-4d95-9e7e-9ea25d18080c req-1097f464-4806-4aee-a7a5-effb256d4e1b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425780 Nov 24 11:17:56.921936 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-9a552c86-40ca-449b-8445-152e2fabde19 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:56.923486 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-9a552c86-40ca-449b-8445-152e2fabde19 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/networks?id=c3a531f2-bfe9-4a80-8b71-ad7f35944879 HTTP/1.1" status: 200 len: 815 time: 0.1068885 Nov 24 11:17:56.941312 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-3b7d3ed6-620a-463d-9c51-ab2a98783f6c tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/quotas/41b5f46d34ad4033a154a9afabe2091f HTTP/1.1" status: 200 len: 375 time: 0.0096574 Nov 24 11:17:56.996659 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-696f9ba1-8736-413d-a35f-19b86e878c93 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=41b5f46d34ad4033a154a9afabe2091f&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0493164 Nov 24 11:17:57.091673 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-23396950-21b6-41ed-b934-ae33118d2e79 service neutron] 10.222.0.76 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819006 Nov 24 11:17:57.185125 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-1dd6c00e-089a-4e11-acd5-f5defc317c7c service neutron] 10.222.0.76 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876222 Nov 24 11:17:57.238911 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be524cc-ccde-4d88-b064-c25d7967d22c req-185545aa-676f-4d9b-b9bb-0847965e6020 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:57.240405 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1be524cc-ccde-4d88-b064-c25d7967d22c req-185545aa-676f-4d9b-b9bb-0847965e6020 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0511854 Nov 24 11:17:57.286621 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1be524cc-ccde-4d88-b064-c25d7967d22c req-34737052-c6d8-4d29-8f99-08587cec073d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400214 Nov 24 11:17:57.520780 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4b01510a-bd90-4334-9ef2-316f455d79db req-b9340627-edff-4309-8ee2-b29513e231f8 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 210 time: 0.0253785 Nov 24 11:17:57.702107 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30134b7e-003a-4500-9062-5c4fd728c829 req-98fa74c0-2c79-4116-8d37-b78ea6880d5a tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:57.703877 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-30134b7e-003a-4500-9062-5c4fd728c829 req-98fa74c0-2c79-4116-8d37-b78ea6880d5a tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0522025 Nov 24 11:17:57.750413 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-30134b7e-003a-4500-9062-5c4fd728c829 req-50361abd-c380-411e-a18c-cc3cf21ec3d7 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406668 Nov 24 11:17:58.102919 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5743db8f-ce25-4437-ad69-6147d70273e5 req-bec45311-bab5-49c1-a9e0-c2c9cca3bb56 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:58.104467 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5743db8f-ce25-4437-ad69-6147d70273e5 req-bec45311-bab5-49c1-a9e0-c2c9cca3bb56 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0488443 Nov 24 11:17:58.155531 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5743db8f-ce25-4437-ad69-6147d70273e5 req-aa94656c-a735-4efa-8d94-f173194569fe tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450530 Nov 24 11:17:58.197803 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b3c1be-9a04-4321-8fa0-8a4353f4a31e req-5b9a38b7-8cae-477a-92f6-7600fdc7d2e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:58.200766 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-44b3c1be-9a04-4321-8fa0-8a4353f4a31e req-5b9a38b7-8cae-477a-92f6-7600fdc7d2e9 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=30efcb46099b42a3a76be0d52d0d0213&device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 1099 time: 0.0421915 Nov 24 11:17:58.295955 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b3c1be-9a04-4321-8fa0-8a4353f4a31e req-5736bbc0-66f8-4d78-b3ee-805a78270594 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:58.297545 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-44b3c1be-9a04-4321-8fa0-8a4353f4a31e req-5736bbc0-66f8-4d78-b3ee-805a78270594 service neutron] 10.222.0.86 "GET /v2.0/networks?id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a HTTP/1.1" status: 200 len: 921 time: 0.0883937 Nov 24 11:17:58.341390 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-44b3c1be-9a04-4321-8fa0-8a4353f4a31e req-a5754b86-bcfc-4c6e-abbf-ef534011ea4f service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bc9cf739-16b6-4224-a3fd-869dd9adb0f4 HTTP/1.1" status: 200 len: 217 time: 0.0354030 Nov 24 11:17:58.392497 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44b3c1be-9a04-4321-8fa0-8a4353f4a31e req-07e0e86b-0318-4cdd-ac0d-f60759da1462 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:58.394056 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-44b3c1be-9a04-4321-8fa0-8a4353f4a31e req-07e0e86b-0318-4cdd-ac0d-f60759da1462 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=e89fe7df-9fbd-43c3-9f7a-0597324b938f HTTP/1.1" status: 200 len: 859 time: 0.0443773 Nov 24 11:17:58.412069 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c166c0eb-2e02-4e4c-a01f-885b0dd5b1c7 req-1f194996-19e8-4fc7-9d5d-982e9445b541 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:58.413996 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c166c0eb-2e02-4e4c-a01f-885b0dd5b1c7 req-1f194996-19e8-4fc7-9d5d-982e9445b541 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0524862 Nov 24 11:17:58.428749 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-44b3c1be-9a04-4321-8fa0-8a4353f4a31e req-9e5985ce-0a39-4059-80ca-579724c8dd43 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0250356 Nov 24 11:17:58.462227 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c166c0eb-2e02-4e4c-a01f-885b0dd5b1c7 req-3c93c6b0-b839-4a53-9e37-9ad87853e3e1 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421104 Nov 24 11:17:58.522762 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-44b3c1be-9a04-4321-8fa0-8a4353f4a31e req-0f8ccc64-7885-45ff-a9b8-0f6c5d978063 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854714 Nov 24 11:17:58.598887 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f3bd4bdf-e36c-4af0-b72a-d11e71f6ae64 req-1b5c68f9-dbed-41bd-893a-bc3efc6ef4c5 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 210 time: 0.0258775 Nov 24 11:17:58.618235 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-44b3c1be-9a04-4321-8fa0-8a4353f4a31e req-492b00b4-ca60-411c-b29f-da7eb6337c36 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869930 Nov 24 11:17:59.271337 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c2608e6-2a2d-4666-b0a8-5d6bb08b9ceb req-34c9b1cc-c536-4dd3-b175-b0acd25511a5 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:59.272918 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6c2608e6-2a2d-4666-b0a8-5d6bb08b9ceb req-34c9b1cc-c536-4dd3-b175-b0acd25511a5 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0501523 Nov 24 11:17:59.327719 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6c2608e6-2a2d-4666-b0a8-5d6bb08b9ceb req-a78dfceb-b227-49f7-9bef-482cc33789ad tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476718 Nov 24 11:17:59.586889 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18fb9004-f762-4fce-b0d0-4515b1ba78c0 req-92745475-91b4-47f1-8581-2b8e92c83427 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:17:59.588347 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-18fb9004-f762-4fce-b0d0-4515b1ba78c0 req-92745475-91b4-47f1-8581-2b8e92c83427 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0517879 Nov 24 11:17:59.634763 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-18fb9004-f762-4fce-b0d0-4515b1ba78c0 req-4d5e6596-d27b-4db8-a50f-ac57ca53ce49 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404203 Nov 24 11:17:59.690960 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4af13dd8-258c-483f-a528-8d4b99a7a5f4 req-5e31b2e4-75f5-4576-980e-1864c1d90ac0 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 210 time: 0.0253994 Nov 24 11:18:00.139367 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-4d56ba17-32a1-449c-9ca0-d21c0cc73471 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:00.140853 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-4d56ba17-32a1-449c-9ca0-d21c0cc73471 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.86 "GET /v2.0/networks?id=c3a531f2-bfe9-4a80-8b71-ad7f35944879 HTTP/1.1" status: 200 len: 815 time: 0.1006355 Nov 24 11:18:00.154279 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Request body: {'port': {'device_id': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'admin_state_up': True, 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:18:00.315561 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Made reservation on behalf of 41b5f46d34ad4033a154a9afabe2091f for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:18:00.319113 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:00.452106 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05a589da-6282-410c-a175-d67df9975879 req-5fdeed12-55ba-4830-abd2-89f398fc764a tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:00.453843 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-05a589da-6282-410c-a175-d67df9975879 req-5fdeed12-55ba-4830-abd2-89f398fc764a tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0490880 Nov 24 11:18:00.460219 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Allocated IP 172.20.0.12 (c3a531f2-bfe9-4a80-8b71-ad7f35944879/08393eb4-7b60-4211-937a-8e0724891dbc/57415158-968f-4f63-9c5f-eba02f4dd725) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:18:00.505724 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-05a589da-6282-410c-a175-d67df9975879 req-b0c5e4af-4c4b-4403-9131-5974ed0c23c4 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456774 Nov 24 11:18:00.619422 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:00.733582 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:00.766507 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7f50c2b-e840-41db-925d-a8fe92093d7b req-4882a9e1-6b6d-4711-acc0-77590c5bfbda tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:00.768586 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c7f50c2b-e840-41db-925d-a8fe92093d7b req-4882a9e1-6b6d-4711-acc0-77590c5bfbda tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0588291 Nov 24 11:18:00.815124 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Network c3a531f2-bfe9-4a80-8b71-ad7f35944879 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:18:00.823953 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:18:00.840404 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:18:00.849257 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:00.856032 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:00.871770 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event updated for resources: {'Port': ['ID=57415158-968f-4f63-9c5f-eba02f4dd725,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:00.904177 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4347276a-13e0-410c-b74e-018e6357f51a req-2b250f12-161d-4d12-942d-b5f5d09d1594 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:00.905798 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4347276a-13e0-410c-b74e-018e6357f51a req-2b250f12-161d-4d12-942d-b5f5d09d1594 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 932 time: 0.1290467 Nov 24 11:18:00.929293 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c7f50c2b-e840-41db-925d-a8fe92093d7b req-dc263c3e-b8f0-40ac-99d3-551ea2b0626a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1029589 Nov 24 11:18:00.953613 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-a082ee6f-3d11-4014-9f1a-7848163a7715 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8025310 Nov 24 11:18:01.016077 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4347276a-13e0-410c-b74e-018e6357f51a req-f11ccdd9-bb87-4ce5-8711-9e1e07a1b21e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0908198 Nov 24 11:18:01.274960 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-7c97eacd-9ce3-4f92-b0f1-a7d4553ff096 None None] Provisioning complete for port 57415158-968f-4f63-9c5f-eba02f4dd725 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:18:01.275589 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-7c97eacd-9ce3-4f92-b0f1-a7d4553ff096 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:01.309995 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-7c97eacd-9ce3-4f92-b0f1-a7d4553ff096 None None] Port 57415158-968f-4f63-9c5f-eba02f4dd725 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:18:01.631016 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e91d7091-403e-4ddd-a691-6785e52d13fb req-75519a58-7bc7-4e96-929b-8e0924daba02 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:01.632522 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e91d7091-403e-4ddd-a691-6785e52d13fb req-75519a58-7bc7-4e96-929b-8e0924daba02 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0561483 Nov 24 11:18:01.684663 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e91d7091-403e-4ddd-a691-6785e52d13fb req-31999a26-29f2-4b22-b3e0-0886d0b61c35 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461779 Nov 24 11:18:02.067097 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5cb4e45-8d3a-4273-b49e-904ebd535230 req-7b8fe25c-c3ed-4315-ab1d-b01285511204 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:02.068886 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c5cb4e45-8d3a-4273-b49e-904ebd535230 req-7b8fe25c-c3ed-4315-ab1d-b01285511204 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0679207 Nov 24 11:18:02.161149 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c5cb4e45-8d3a-4273-b49e-904ebd535230 req-5f78b056-1547-4b12-b644-1e15297ebed2 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0835056 Nov 24 11:18:02.177904 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a5daae3-64e9-4d00-b3f9-07fab9e3a6f4 req-5f2a0b4b-efb5-439c-968c-7efc4c5a7c63 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:02.180398 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8a5daae3-64e9-4d00-b3f9-07fab9e3a6f4 req-5f2a0b4b-efb5-439c-968c-7efc4c5a7c63 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 932 time: 0.0738285 Nov 24 11:18:02.231152 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8a5daae3-64e9-4d00-b3f9-07fab9e3a6f4 req-3db7149d-14ff-4e05-9119-5df3f9233b74 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445065 Nov 24 11:18:03.052459 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:18:03.289820 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-558819bb-e454-4fba-b6ce-99a60bc6c15e req-caa1deb4-4b51-4a5b-af78-b4c4b55a22f3 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:03.291468 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-558819bb-e454-4fba-b6ce-99a60bc6c15e req-caa1deb4-4b51-4a5b-af78-b4c4b55a22f3 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0533023 Nov 24 11:18:03.383828 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-558819bb-e454-4fba-b6ce-99a60bc6c15e req-c57e6c91-4706-424c-94c2-0c09d339ff1a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0832584 Nov 24 11:18:03.403211 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e07a6b-701f-48ae-a608-6607d496671f req-1e127cd5-024d-46e3-bc46-65d2a368ff4b tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:03.403211 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-27e07a6b-701f-48ae-a608-6607d496671f req-1e127cd5-024d-46e3-bc46-65d2a368ff4b tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 932 time: 0.0964482 Nov 24 11:18:03.466044 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-27e07a6b-701f-48ae-a608-6607d496671f req-6c8dfd70-d2fd-4a0e-ad74-ebce93693c5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606623 Nov 24 11:18:03.510641 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2c6fed5-3a5d-4ab8-b602-5c03b74ebe8b req-32b44caf-c350-4a88-a5d3-8e91bf00b8f2 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:03.512148 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d2c6fed5-3a5d-4ab8-b602-5c03b74ebe8b req-32b44caf-c350-4a88-a5d3-8e91bf00b8f2 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0615487 Nov 24 11:18:03.580368 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d2c6fed5-3a5d-4ab8-b602-5c03b74ebe8b req-323a879c-7ea4-4ba7-b79a-c0f84980c6e4 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0623233 Nov 24 11:18:04.521210 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9c0a037-0750-44b4-8ac7-da7d795e6354 req-f238bfec-c316-4cd2-8623-19347d1699a1 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:04.522822 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c9c0a037-0750-44b4-8ac7-da7d795e6354 req-f238bfec-c316-4cd2-8623-19347d1699a1 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0531290 Nov 24 11:18:04.584257 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c9c0a037-0750-44b4-8ac7-da7d795e6354 req-d2b086db-2d0d-4377-9c34-94ea1850007b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0550644 Nov 24 11:18:04.754913 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c728c4-5d67-4b8d-9b2e-f9e3d32c9fff req-fa70c238-fd86-4684-9e35-411d109c7c82 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:04.754913 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-91c728c4-5d67-4b8d-9b2e-f9e3d32c9fff req-fa70c238-fd86-4684-9e35-411d109c7c82 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 932 time: 0.0519991 Nov 24 11:18:04.758580 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-91c728c4-5d67-4b8d-9b2e-f9e3d32c9fff req-953d986e-06ee-4208-9b23-3ede9468b18b tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455916 Nov 24 11:18:05.728524 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5d4c694-d05c-42e0-8ab1-5b6596607e5e req-123b4d9b-76f3-4f4f-80fd-63d88bd77863 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:05.730698 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c5d4c694-d05c-42e0-8ab1-5b6596607e5e req-123b4d9b-76f3-4f4f-80fd-63d88bd77863 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0682476 Nov 24 11:18:05.777611 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c5d4c694-d05c-42e0-8ab1-5b6596607e5e req-e731cfd6-2271-4309-bf72-49b8610cbb5b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406597 Nov 24 11:18:05.896059 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d06eca-01c5-4633-a312-077998621da7 req-1b367403-cdb5-4e9b-bd80-af8084b95e9d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:05.897495 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-90d06eca-01c5-4633-a312-077998621da7 req-1b367403-cdb5-4e9b-bd80-af8084b95e9d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 932 time: 0.0488617 Nov 24 11:18:05.955786 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-90d06eca-01c5-4633-a312-077998621da7 req-e0aa2946-d15d-4be0-8274-e34b98f1febc tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468976 Nov 24 11:18:06.918741 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1a05247-9b44-494e-ba63-bdbd34579967 req-fdfca529-e897-4317-86b0-ebf0b51a5aa6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:06.920327 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f1a05247-9b44-494e-ba63-bdbd34579967 req-fdfca529-e897-4317-86b0-ebf0b51a5aa6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0582376 Nov 24 11:18:06.978803 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f1a05247-9b44-494e-ba63-bdbd34579967 req-8a397e7e-cca2-4508-b42a-88ee96578a06 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509381 Nov 24 11:18:07.095257 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4c04ee-6eaa-4c7f-a7de-4caac42a649e req-8e08a8b7-c76d-411c-9659-d7b21049fdbd tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:07.096846 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5a4c04ee-6eaa-4c7f-a7de-4caac42a649e req-8e08a8b7-c76d-411c-9659-d7b21049fdbd tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 932 time: 0.0529032 Nov 24 11:18:07.148598 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5a4c04ee-6eaa-4c7f-a7de-4caac42a649e req-4fb986f6-58a0-412d-8a02-2507ea077861 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458260 Nov 24 11:18:08.109179 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5447dfc-8e22-462c-8177-39c4ee5b0866 req-f20a03ce-95cd-4028-8a67-9fbd70cc2c05 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:08.110657 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a5447dfc-8e22-462c-8177-39c4ee5b0866 req-f20a03ce-95cd-4028-8a67-9fbd70cc2c05 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0565596 Nov 24 11:18:08.160540 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a5447dfc-8e22-462c-8177-39c4ee5b0866 req-eb0a32eb-9ef1-49e1-82cd-bff435fffc6f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439079 Nov 24 11:18:08.286048 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-880badf3-c42b-4f5e-ac00-0d40c9739897 req-a1cba441-bd05-40f4-afa9-1f50b4ff7c43 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:08.287572 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-880badf3-c42b-4f5e-ac00-0d40c9739897 req-a1cba441-bd05-40f4-afa9-1f50b4ff7c43 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 932 time: 0.0516665 Nov 24 11:18:08.336940 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-880badf3-c42b-4f5e-ac00-0d40c9739897 req-ca510988-5edf-465d-bca5-e67e869a3f87 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428388 Nov 24 11:18:08.727444 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-2c373a9e-52ae-451a-a576-1a3916fb0bdd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:09.138604 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:09.316908 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a5addf1-be7c-4f12-8c04-87a4329ca6a9 req-cb5be262-8bdc-4ab0-9f0f-13aa2be18fe9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:09.318385 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5a5addf1-be7c-4f12-8c04-87a4329ca6a9 req-cb5be262-8bdc-4ab0-9f0f-13aa2be18fe9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0674150 Nov 24 11:18:09.367456 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5a5addf1-be7c-4f12-8c04-87a4329ca6a9 req-14d1b475-6752-489e-8b45-fab76752bcbf tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428882 Nov 24 11:18:09.492209 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff1a0eb5-2757-4e74-b463-bcd6c23a9998 req-3ea5d9f0-2227-444e-a7b1-506bc3b4c7b4 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:09.493571 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff1a0eb5-2757-4e74-b463-bcd6c23a9998 req-3ea5d9f0-2227-444e-a7b1-506bc3b4c7b4 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 932 time: 0.0519197 Nov 24 11:18:09.544496 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff1a0eb5-2757-4e74-b463-bcd6c23a9998 req-bdf80f24-f157-49c5-a998-530ae5aef02b tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448115 Nov 24 11:18:10.494271 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efe399cb-08c6-458f-95cb-3dfd5d1b2caf req-e520188e-b882-467e-98e9-1090fd6add1a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:10.496336 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-efe399cb-08c6-458f-95cb-3dfd5d1b2caf req-e520188e-b882-467e-98e9-1090fd6add1a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0502012 Nov 24 11:18:10.546856 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-efe399cb-08c6-458f-95cb-3dfd5d1b2caf req-ecf226d0-4c82-4a96-b3a7-bad38555fcbd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445902 Nov 24 11:18:10.663684 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c362fcb-7645-4631-a1fd-a6e8f700d4ce req-9819b549-efbc-493b-9b26-504b225c67aa tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:10.665035 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8c362fcb-7645-4631-a1fd-a6e8f700d4ce req-9819b549-efbc-493b-9b26-504b225c67aa tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 932 time: 0.0478997 Nov 24 11:18:10.718232 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8c362fcb-7645-4631-a1fd-a6e8f700d4ce req-1906e7bb-cf6d-4b72-a8bf-16064187c92e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464067 Nov 24 11:18:11.152672 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-8d3e5e7e-d932-483e-b716-ca1b7103d24d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:11.673347 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-879d8416-c6dd-448e-906b-c9c8122540e9 req-dbd4c6a7-7767-4695-8020-3fb284e3a198 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:11.674946 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-879d8416-c6dd-448e-906b-c9c8122540e9 req-dbd4c6a7-7767-4695-8020-3fb284e3a198 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0497711 Nov 24 11:18:11.723338 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-879d8416-c6dd-448e-906b-c9c8122540e9 req-0738f3a4-68c6-493d-b80d-bb7d8243ca69 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422301 Nov 24 11:18:11.845823 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-703f27f1-2158-44d4-9bfa-1e83e5c24220 req-1aa218b1-762b-450c-b8a8-377f92e20f3f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:11.847384 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-703f27f1-2158-44d4-9bfa-1e83e5c24220 req-1aa218b1-762b-450c-b8a8-377f92e20f3f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 932 time: 0.0523450 Nov 24 11:18:11.898727 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-703f27f1-2158-44d4-9bfa-1e83e5c24220 req-ceee450e-ff5f-4065-a636-b8db28057f92 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452909 Nov 24 11:18:12.430330 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:12.849198 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dce4a7cf-5175-4a07-8c68-0a62b73140cb req-b7444908-a044-492d-b121-22f2472dfd75 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:12.850644 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dce4a7cf-5175-4a07-8c68-0a62b73140cb req-b7444908-a044-492d-b121-22f2472dfd75 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0509882 Nov 24 11:18:12.898847 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dce4a7cf-5175-4a07-8c68-0a62b73140cb req-7204fe2d-0691-4fcf-8f23-343df62027ef tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412571 Nov 24 11:18:13.013651 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484d458f-e84f-496c-95fc-038b824a6d61 req-82e5735e-378d-4a29-bc4e-8f591af7e1a5 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:13.015043 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-484d458f-e84f-496c-95fc-038b824a6d61 req-82e5735e-378d-4a29-bc4e-8f591af7e1a5 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 932 time: 0.0476654 Nov 24 11:18:13.061674 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-484d458f-e84f-496c-95fc-038b824a6d61 req-0376da92-abb9-4a2f-954f-7c2ef25d7c3b tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408227 Nov 24 11:18:13.208399 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Request body: {'port': {'device_id': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:18:13.263544 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:13.333479 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c938eae-e67f-4a42-801f-fbf1940f6ec8 req-52eb1802-e76f-4d17-a1c2-37fd6d16a6c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:13.334853 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5c938eae-e67f-4a42-801f-fbf1940f6ec8 req-52eb1802-e76f-4d17-a1c2-37fd6d16a6c2 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 1097 time: 0.0442460 Nov 24 11:18:13.473531 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c938eae-e67f-4a42-801f-fbf1940f6ec8 req-94ac3612-9f3e-4403-9f28-b09e60b7dc75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:13.475244 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5c938eae-e67f-4a42-801f-fbf1940f6ec8 req-94ac3612-9f3e-4403-9f28-b09e60b7dc75 service neutron] 10.222.0.86 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 919 time: 0.0896430 Nov 24 11:18:13.525648 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 57415158-968f-4f63-9c5f-eba02f4dd725 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:18:13.533308 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:13.546402 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Transition to ACTIVE for port object 57415158-968f-4f63-9c5f-eba02f4dd725 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:18:13.554566 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5c938eae-e67f-4a42-801f-fbf1940f6ec8 req-f358b399-cfd0-4c1e-a439-6c5058b23dd3 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 HTTP/1.1" status: 200 len: 1000 time: 0.0656404 Nov 24 11:18:13.607437 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c938eae-e67f-4a42-801f-fbf1940f6ec8 req-7bc52edb-2dd2-4f23-8e3d-fa2791b31ac3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:13.607667 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:13.608856 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5c938eae-e67f-4a42-801f-fbf1940f6ec8 req-7bc52edb-2dd2-4f23-8e3d-fa2791b31ac3 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=5eae2e87-935a-45b7-89da-586ce04ad644 HTTP/1.1" status: 200 len: 856 time: 0.0436945 Nov 24 11:18:13.665577 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c938eae-e67f-4a42-801f-fbf1940f6ec8 req-95b44a7f-5666-4631-842e-825f19df11b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:13.667755 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5c938eae-e67f-4a42-801f-fbf1940f6ec8 req-95b44a7f-5666-4631-842e-825f19df11b6 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=76fcee22-81e5-4608-a546-3b68c56c5ac7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0423615 Nov 24 11:18:13.679531 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Pushing event updated for resources: {'Port': ['ID=57415158-968f-4f63-9c5f-eba02f4dd725,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:13.694582 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:13.694933 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:13.695279 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:13.695669 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:13.696008 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:13.696386 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:13.696672 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:13.697000 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:13.697390 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:13.697725 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:13.698216 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:13.698548 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:13.704425 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Attempting to bind port 57415158-968f-4f63-9c5f-eba02f4dd725 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:18:13.704759 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Attempting to bind port 57415158-968f-4f63-9c5f-eba02f4dd725 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:18:13.705090 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Attempting to bind port 57415158-968f-4f63-9c5f-eba02f4dd725 on network c3a531f2-bfe9-4a80-8b71-ad7f35944879 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:18:13.711378 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Port 57415158-968f-4f63-9c5f-eba02f4dd725 on network c3a531f2-bfe9-4a80-8b71-ad7f35944879 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:18:13.711378 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Attempting to bind port 57415158-968f-4f63-9c5f-eba02f4dd725 on network c3a531f2-bfe9-4a80-8b71-ad7f35944879 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:18:13.717946 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 18, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:18:13.718276 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Checking segment: {'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:18:13.718652 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Bound using segment: {'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:18:13.719081 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Bound port: 57415158-968f-4f63-9c5f-eba02f4dd725, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '71343ab0-4290-4798-8417-9a4b559b66e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1225, 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:18:13.719704 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:13.789244 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5c938eae-e67f-4a42-801f-fbf1940f6ec8 req-c6cbbec2-9bb9-4b95-bc1f-6507415073e5 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1087697 Nov 24 11:18:13.796291 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] For port 57415158-968f-4f63-9c5f-eba02f4dd725, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:18:13.799744 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] For port 57415158-968f-4f63-9c5f-eba02f4dd725, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=57415158-968f-4f63-9c5f-eba02f4dd725,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:18:13.882456 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:13.890688 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5c938eae-e67f-4a42-801f-fbf1940f6ec8 req-e5a63285-793e-4d85-bd13-62daf3fbe016 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0927899 Nov 24 11:18:13.921224 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:13.922163 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:13.924463 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] 10.222.0.86 "PUT /v2.0/ports/57415158-968f-4f63-9c5f-eba02f4dd725 HTTP/1.1" status: 200 len: 1094 time: 0.7203665 Nov 24 11:18:13.930510 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:18:13.933390 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-03463a5a-c65a-4055-8f0f-517ff5236b50" -d '{"events": [{"name": "network-changed", "server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:18:13.974864 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3269acc-99ce-4d9a-83e8-d9efb64d5c65 service neutron] Pushing event updated for resources: {'Port': ['ID=57415158-968f-4f63-9c5f-eba02f4dd725,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:14.034788 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:18:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1f6be538-df5b-4a87-98de-9e15640eed3c x-openstack-request-id: req-1f6be538-df5b-4a87-98de-9e15640eed3c {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:18:14.034788 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:18:14.034788 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-1f6be538-df5b-4a87-98de-9e15640eed3c {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:18:14.034788 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725', 'status': 'completed', 'code': 200} Nov 24 11:18:14.082302 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:14.087624 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11d0093-7ce7-4d00-878b-f4702f936f09 req-8f8f8364-3a03-4b12-8826-a9f1bce2aad8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:14.092610 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e11d0093-7ce7-4d00-878b-f4702f936f09 req-8f8f8364-3a03-4b12-8826-a9f1bce2aad8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0731239 Nov 24 11:18:14.136838 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03463a5a-c65a-4055-8f0f-517ff5236b50 req-0c12738e-ab13-4724-8b35-017e3ae6b087 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:14.139467 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-03463a5a-c65a-4055-8f0f-517ff5236b50 req-0c12738e-ab13-4724-8b35-017e3ae6b087 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=41b5f46d34ad4033a154a9afabe2091f&device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 1097 time: 0.0814180 Nov 24 11:18:14.176015 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e11d0093-7ce7-4d00-878b-f4702f936f09 req-7c01647a-1577-41bb-ac58-c0c6cfb5c79d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0791335 Nov 24 11:18:14.255703 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93c534bc-0f2a-4caa-8bf3-3c8623ce7d05 req-2f564e12-e216-44a0-9b9f-c6dd3f24b714 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:14.257379 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-93c534bc-0f2a-4caa-8bf3-3c8623ce7d05 req-2f564e12-e216-44a0-9b9f-c6dd3f24b714 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 944 time: 0.0603797 Nov 24 11:18:14.286291 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03463a5a-c65a-4055-8f0f-517ff5236b50 req-5edea169-c546-4625-8209-f04fa079ac3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:14.287812 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-03463a5a-c65a-4055-8f0f-517ff5236b50 req-5edea169-c546-4625-8209-f04fa079ac3a service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=41b5f46d34ad4033a154a9afabe2091f&shared=False HTTP/1.1" status: 200 len: 917 time: 0.1295040 Nov 24 11:18:14.306246 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-93c534bc-0f2a-4caa-8bf3-3c8623ce7d05 req-681a1ed1-de21-4cf8-a83a-339934cabb48 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423090 Nov 24 11:18:14.393222 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03463a5a-c65a-4055-8f0f-517ff5236b50 req-140ac38d-2955-422c-9b92-79f1f786c436 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:14.394576 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-03463a5a-c65a-4055-8f0f-517ff5236b50 req-140ac38d-2955-422c-9b92-79f1f786c436 service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.0936520 Nov 24 11:18:14.515969 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c5a32ee0-8be3-4d04-b7e8-47c207018072 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:14.517505 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-c5a32ee0-8be3-4d04-b7e8-47c207018072 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=41b5f46d34ad4033a154a9afabe2091f&device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 1097 time: 0.0408854 Nov 24 11:18:14.563101 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-d8b26bed-0e30-4893-966a-9d7e934cc18c service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=57415158-968f-4f63-9c5f-eba02f4dd725 HTTP/1.1" status: 200 len: 217 time: 0.0363894 Nov 24 11:18:14.614249 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-4f181fe0-92dd-43a1-b24c-c09f620590d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:14.615757 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-4f181fe0-92dd-43a1-b24c-c09f620590d1 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=08393eb4-7b60-4211-937a-8e0724891dbc HTTP/1.1" status: 200 len: 854 time: 0.0441027 Nov 24 11:18:14.670130 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-b26ccfb8-61f0-4a0b-9ca4-6974ea3d09c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:14.671793 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-b26ccfb8-61f0-4a0b-9ca4-6974ea3d09c8 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=c3a531f2-bfe9-4a80-8b71-ad7f35944879&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0418782 Nov 24 11:18:14.773291 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-6fb5283c-3b9c-4aaa-8299-e2147b9f3e49 service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881777 Nov 24 11:18:14.824858 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:14.870727 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e4c5c776-bc21-47c7-bcbf-75ae819fb6eb req-d8349f6d-a7cd-443f-a6c4-82a369f2c088 service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0879736 Nov 24 11:18:15.301241 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfabc3d6-4bd3-486a-8c2c-ef6af12e1f5c req-f6ef6e14-5565-435d-88e4-0bdede5d8303 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:15.302752 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cfabc3d6-4bd3-486a-8c2c-ef6af12e1f5c req-f6ef6e14-5565-435d-88e4-0bdede5d8303 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0504618 Nov 24 11:18:15.358875 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cfabc3d6-4bd3-486a-8c2c-ef6af12e1f5c req-55cfaeae-3c8c-4dc2-a33e-8148bb69319e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496600 Nov 24 11:18:15.432308 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35467cae-b9b4-4990-a6d0-54946317bc50 req-74fa4099-69fc-44a5-a0ca-450fd0dd572f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:15.433773 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-35467cae-b9b4-4990-a6d0-54946317bc50 req-74fa4099-69fc-44a5-a0ca-450fd0dd572f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 944 time: 0.0536113 Nov 24 11:18:15.489570 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-35467cae-b9b4-4990-a6d0-54946317bc50 req-52e927eb-6afc-4aa2-9259-1136953f41db tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490975 Nov 24 11:18:16.479891 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e504f5e-5609-41e4-9c28-bc4bbfa70ba3 req-02bae047-892f-473d-8d26-dbb7df9bdd54 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:16.481335 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9e504f5e-5609-41e4-9c28-bc4bbfa70ba3 req-02bae047-892f-473d-8d26-dbb7df9bdd54 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 944 time: 0.0483141 Nov 24 11:18:16.528994 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9e504f5e-5609-41e4-9c28-bc4bbfa70ba3 req-8116a3c5-f4ce-4c29-8406-8d4dcb2e9036 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417650 Nov 24 11:18:16.608011 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89f3c879-88de-43a2-82e4-ec4668a8d84a req-d1564902-db44-4abe-9498-7ff7716c559e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:16.609435 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-89f3c879-88de-43a2-82e4-ec4668a8d84a req-d1564902-db44-4abe-9498-7ff7716c559e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 944 time: 0.0515461 Nov 24 11:18:16.654938 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-89f3c879-88de-43a2-82e4-ec4668a8d84a req-bf849100-dbf6-40d3-8300-808054aee406 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396647 Nov 24 11:18:17.060793 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 57415158-968f-4f63-9c5f-eba02f4dd725 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:18:17.155695 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 57415158-968f-4f63-9c5f-eba02f4dd725, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=57415158-968f-4f63-9c5f-eba02f4dd725,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:18:17.167399 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '57415158-968f-4f63-9c5f-eba02f4dd725', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'port_id': '57415158-968f-4f63-9c5f-eba02f4dd725', 'mac_address': 'fa:16:3e:ad:76:17', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1225, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:18:17.203849 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:17.215852 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 57415158-968f-4f63-9c5f-eba02f4dd725 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:18:17.234673 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 57415158-968f-4f63-9c5f-eba02f4dd725, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=57415158-968f-4f63-9c5f-eba02f4dd725,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:18:17.292824 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:17.293472 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:18:17.368499 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=57415158-968f-4f63-9c5f-eba02f4dd725,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:17.400378 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:17.400723 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:17.401607 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:17.401910 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:17.402237 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:17.402591 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:17.402924 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:17.403249 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:17.403612 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:17.403941 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:17.404261 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:17.404579 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:17.436806 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:18:17.447490 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'port_id': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'mac_address': 'fa:16:3e:ec:fd:da', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1229, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:18:17.484669 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:17.500396 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:18:17.518970 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:18:17.590890 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:17.639196 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,revision_number=9']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:17.649249 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74600c9b-b8bb-40cc-abeb-ba72b1f69bb3 req-afc680d6-933b-4dc2-a3e4-5fc4b169c742 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:17.650707 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-74600c9b-b8bb-40cc-abeb-ba72b1f69bb3 req-afc680d6-933b-4dc2-a3e4-5fc4b169c742 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.0490980 Nov 24 11:18:17.698934 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-74600c9b-b8bb-40cc-abeb-ba72b1f69bb3 req-f0a7e5c9-cbe7-471c-92e4-4d24bfac84bb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409665 Nov 24 11:18:17.768127 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d466dd9d-2518-48fb-ada8-e611534a2c21 req-1a88399f-52b4-48c2-8461-4b68e6cd38dc tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:17.769472 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d466dd9d-2518-48fb-ada8-e611534a2c21 req-1a88399f-52b4-48c2-8461-4b68e6cd38dc tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 945 time: 0.0473697 Nov 24 11:18:17.821008 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d466dd9d-2518-48fb-ada8-e611534a2c21 req-08114f01-446f-4100-98fd-a939c01e14e6 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455847 Nov 24 11:18:17.968372 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['57415158-968f-4f63-9c5f-eba02f4dd725'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:18:18.022604 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['ebbec69a-2982-4fe3-b07d-5326d6b7f5f3'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:18:18.818927 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d5dd785-7a88-4fbb-bcee-c0c4ae2e2698 req-9066b227-49ff-4d03-8c45-8df9590f2e44 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:18.820376 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2d5dd785-7a88-4fbb-bcee-c0c4ae2e2698 req-9066b227-49ff-4d03-8c45-8df9590f2e44 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.0474408 Nov 24 11:18:18.867879 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2d5dd785-7a88-4fbb-bcee-c0c4ae2e2698 req-619c4204-f2ce-4efe-8579-459778d98c14 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409839 Nov 24 11:18:18.942215 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93e390aa-94d5-44eb-b557-39224dd47937 req-fb9228f2-28b2-4512-a262-40222005e629 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:18.943809 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-93e390aa-94d5-44eb-b557-39224dd47937 req-fb9228f2-28b2-4512-a262-40222005e629 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 945 time: 0.0531721 Nov 24 11:18:18.991806 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-93e390aa-94d5-44eb-b557-39224dd47937 req-93071b3f-5e06-4095-809a-6827d71a84e8 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409422 Nov 24 11:18:19.992459 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94e54fe3-2aa4-4e63-9904-b8aac8d0653d req-e19dbf9d-a93a-4e98-a9a8-02763f3ffa18 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:19.993920 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-94e54fe3-2aa4-4e63-9904-b8aac8d0653d req-e19dbf9d-a93a-4e98-a9a8-02763f3ffa18 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.0534890 Nov 24 11:18:20.042569 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-94e54fe3-2aa4-4e63-9904-b8aac8d0653d req-5d6b9762-afce-4322-93ba-c8093b45efd8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416317 Nov 24 11:18:20.107829 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed8a0066-4f0e-45eb-ac6f-dad9bc25bba3 req-84003792-3d81-4708-ab14-b994079bd6f7 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:20.109264 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ed8a0066-4f0e-45eb-ac6f-dad9bc25bba3 req-84003792-3d81-4708-ab14-b994079bd6f7 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 945 time: 0.0478661 Nov 24 11:18:20.155251 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ed8a0066-4f0e-45eb-ac6f-dad9bc25bba3 req-5f62d4af-a134-4701-8585-c5943d37ccf9 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397837 Nov 24 11:18:21.079706 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 57415158-968f-4f63-9c5f-eba02f4dd725 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:18:21.164039 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fda441d5-662b-4426-8cbd-377b5bdde0ab req-6c0f967f-a2fd-4295-babb-5977fd0289c1 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:21.165499 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fda441d5-662b-4426-8cbd-377b5bdde0ab req-6c0f967f-a2fd-4295-babb-5977fd0289c1 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 945 time: 0.0509415 Nov 24 11:18:21.195521 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 57415158-968f-4f63-9c5f-eba02f4dd725 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:18:21.199725 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 57415158-968f-4f63-9c5f-eba02f4dd725 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:18:21.200100 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:21.282876 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:21.307130 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:18:21.312031 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be03ead3-b3d5-44aa-a81d-e362549b9826" -d '{"events": [{"server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "name": "network-vif-plugged", "status": "completed", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:18:21.323543 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 57415158-968f-4f63-9c5f-eba02f4dd725, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=57415158-968f-4f63-9c5f-eba02f4dd725,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:18:21.384737 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:21.386519 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:18:21.464665 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=57415158-968f-4f63-9c5f-eba02f4dd725,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:21.468854 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fda441d5-662b-4426-8cbd-377b5bdde0ab req-d5e8f5cd-84d6-478c-bd2d-ce3325694fc8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2967482 Nov 24 11:18:21.479697 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11d189a4-1722-49a2-bada-e02f5d1b7d92 req-627b7367-9a2f-4901-8355-0a17bfe32314 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:21.479874 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:18:21.480458 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:21.481239 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-11d189a4-1722-49a2-bada-e02f5d1b7d92 req-627b7367-9a2f-4901-8355-0a17bfe32314 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 946 time: 0.0698500 Nov 24 11:18:21.531129 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-11d189a4-1722-49a2-bada-e02f5d1b7d92 req-e5bc8cb9-0108-4fa4-8d39-8bab37dd27fa tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432453 Nov 24 11:18:21.553364 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:18:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-77d079d9-736b-4760-a292-5196def54a57 x-openstack-request-id: req-77d079d9-736b-4760-a292-5196def54a57 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:18:21.553674 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "name": "network-vif-plugged", "status": "completed", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:18:21.553930 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-77d079d9-736b-4760-a292-5196def54a57 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:18:21.554313 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725', 'code': 200} Nov 24 11:18:21.570475 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:21.603692 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:18:21.676591 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:21.726730 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,revision_number=10']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:21.883136 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cbeee8e-b236-405a-bb00-e5f857c06772 req-7034b23f-548a-4f7b-b045-e528a01f222c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:21.884655 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-0cbeee8e-b236-405a-bb00-e5f857c06772 req-7034b23f-548a-4f7b-b045-e528a01f222c service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 1099 time: 0.0398068 Nov 24 11:18:21.939364 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-0cbeee8e-b236-405a-bb00-e5f857c06772 req-84735d21-f24f-4180-a9f1-a0b220357901 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463140 Nov 24 11:18:22.602699 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2302596-f03f-4b47-ad15-7bdfcd2793c3 req-531403bc-97ad-47ca-8c39-520fe35d0931 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:22.604366 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a2302596-f03f-4b47-ad15-7bdfcd2793c3 req-531403bc-97ad-47ca-8c39-520fe35d0931 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 947 time: 0.0508952 Nov 24 11:18:22.684849 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ea3cfc5-cf1d-450b-a2d5-a62c3f1821d7 req-70c0ad7f-a8a7-4cc8-965a-1f495cf66671 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:22.686323 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ea3cfc5-cf1d-450b-a2d5-a62c3f1821d7 req-70c0ad7f-a8a7-4cc8-965a-1f495cf66671 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 946 time: 0.0789993 Nov 24 11:18:22.693799 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a2302596-f03f-4b47-ad15-7bdfcd2793c3 req-2770a6bc-121c-4d1f-bdeb-63b20691182b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0783143 Nov 24 11:18:22.735971 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ea3cfc5-cf1d-450b-a2d5-a62c3f1821d7 req-3f451b71-84e1-4d0c-ae06-fc9dd8fe9f7c tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411618 Nov 24 11:18:23.555623 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:18:23.558594 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4e45fd0-bae7-422c-8841-03466a2423ec" -d '{"events": [{"server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "name": "network-vif-plugged", "status": "completed", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:18:23.595920 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:18:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aa4b6296-67de-4dc9-89cb-0aac41055a3d x-openstack-request-id: req-aa4b6296-67de-4dc9-89cb-0aac41055a3d {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:18:23.596236 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "name": "network-vif-plugged", "status": "completed", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:18:23.596489 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-aa4b6296-67de-4dc9-89cb-0aac41055a3d {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:18:23.596881 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'code': 200} Nov 24 11:18:23.822483 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-609b1317-4053-4428-b297-37fd4e68e599 req-ef45d8fe-d3e0-4c56-8954-2042cee9be3e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:23.824588 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-609b1317-4053-4428-b297-37fd4e68e599 req-ef45d8fe-d3e0-4c56-8954-2042cee9be3e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 947 time: 0.0520124 Nov 24 11:18:23.874496 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-609b1317-4053-4428-b297-37fd4e68e599 req-6e8d8ffe-d2a5-44de-906e-eac99466a7e9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436878 Nov 24 11:18:23.984474 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dad9f0d-fa2d-48aa-8642-f929c840a17e req-dfa221a6-64a6-473b-ae6e-5d7e225191d2 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:23.985922 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9dad9f0d-fa2d-48aa-8642-f929c840a17e req-dfa221a6-64a6-473b-ae6e-5d7e225191d2 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 946 time: 0.0514007 Nov 24 11:18:24.048917 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9dad9f0d-fa2d-48aa-8642-f929c840a17e req-f903c620-548f-42bc-b48d-ab9c6b8095b8 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568445 Nov 24 11:18:24.088174 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-156ff2d6-f499-4028-ad19-c2995c9d0148 req-39ce9bfd-3d87-4bfd-a6fb-b6e5bebaf66d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:24.090300 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-156ff2d6-f499-4028-ad19-c2995c9d0148 req-39ce9bfd-3d87-4bfd-a6fb-b6e5bebaf66d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0621469 Nov 24 11:18:24.167797 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-156ff2d6-f499-4028-ad19-c2995c9d0148 req-9dd58c83-72ec-4d5d-8a4e-2bdf4743aa28 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709951 Nov 24 11:18:24.186441 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0cc1fd7-0294-4f58-af2b-1deb47b60da2 req-361ca3d8-228c-452b-aad6-87735009c4c4 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:24.187982 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c0cc1fd7-0294-4f58-af2b-1deb47b60da2 req-361ca3d8-228c-452b-aad6-87735009c4c4 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 946 time: 0.0696657 Nov 24 11:18:24.197963 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff85fdce-5792-4315-89e0-53e8ec76d284 req-c5885bc3-71c8-4ed8-b992-90e0e37efa69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:24.200244 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ff85fdce-5792-4315-89e0-53e8ec76d284 req-c5885bc3-71c8-4ed8-b992-90e0e37efa69 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=30efcb46099b42a3a76be0d52d0d0213&device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 1099 time: 0.0637457 Nov 24 11:18:24.263650 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c0cc1fd7-0294-4f58-af2b-1deb47b60da2 req-24b2ad96-64e0-47f4-942b-4630bd95a762 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582335 Nov 24 11:18:24.328318 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff85fdce-5792-4315-89e0-53e8ec76d284 req-667da243-9b5b-4f96-84da-cc7570e3c63e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:24.330103 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ff85fdce-5792-4315-89e0-53e8ec76d284 req-667da243-9b5b-4f96-84da-cc7570e3c63e service neutron] 10.222.0.86 "GET /v2.0/networks?id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a HTTP/1.1" status: 200 len: 921 time: 0.1200714 Nov 24 11:18:24.403743 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ff85fdce-5792-4315-89e0-53e8ec76d284 req-b95731b6-a250-4214-9fb8-003d9daf367c service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bc9cf739-16b6-4224-a3fd-869dd9adb0f4 HTTP/1.1" status: 200 len: 217 time: 0.0545557 Nov 24 11:18:24.416383 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b305f46c-3c08-4553-a6cc-c70ede14f288 req-3ed675a3-262f-42b0-9bc7-2fa4dcd8a53e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:24.419222 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b305f46c-3c08-4553-a6cc-c70ede14f288 req-3ed675a3-262f-42b0-9bc7-2fa4dcd8a53e service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 1100 time: 0.0521381 Nov 24 11:18:24.460054 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff85fdce-5792-4315-89e0-53e8ec76d284 req-a92fe25e-f829-4ce0-881c-e5bd211afdd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:24.461674 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ff85fdce-5792-4315-89e0-53e8ec76d284 req-a92fe25e-f829-4ce0-881c-e5bd211afdd9 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=e89fe7df-9fbd-43c3-9f7a-0597324b938f HTTP/1.1" status: 200 len: 859 time: 0.0478308 Nov 24 11:18:24.480984 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b305f46c-3c08-4553-a6cc-c70ede14f288 req-97300656-2cdd-459d-8e41-477eac8d07ac service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495112 Nov 24 11:18:24.506070 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ff85fdce-5792-4315-89e0-53e8ec76d284 req-787721c1-c368-484e-8f58-ffa421354adc service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0248258 Nov 24 11:18:24.619944 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9731983b-c66a-4d67-a674-ddb9ca47c87a req-5de91b89-c382-40a4-9034-0e207ce2e76e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:24.621479 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9731983b-c66a-4d67-a674-ddb9ca47c87a req-5de91b89-c382-40a4-9034-0e207ce2e76e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 946 time: 0.0527921 Nov 24 11:18:24.668905 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9731983b-c66a-4d67-a674-ddb9ca47c87a req-07e9827c-5de6-4437-a92d-3724330efbac tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414784 Nov 24 11:18:24.811279 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ff85fdce-5792-4315-89e0-53e8ec76d284 req-463643cf-b2d2-4241-b7fe-8be917949a3c service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0902786 Nov 24 11:18:24.903831 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ff85fdce-5792-4315-89e0-53e8ec76d284 req-4d61f147-f063-4d88-a21a-b03fe94288e1 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0840113 Nov 24 11:18:25.004694 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e5349fe-19ae-4eff-8393-eb991caa2ea3 req-e05eab56-9e28-4e3d-a8db-94217aa100cc tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:25.006166 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3e5349fe-19ae-4eff-8393-eb991caa2ea3 req-e05eab56-9e28-4e3d-a8db-94217aa100cc tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 947 time: 0.0533364 Nov 24 11:18:25.057609 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3e5349fe-19ae-4eff-8393-eb991caa2ea3 req-91636369-7d5c-4a33-bbe9-b303a249c3cd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416219 Nov 24 11:18:25.291732 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f6cb432-c1b0-4235-b260-176431ff5e4f req-ea7c52e8-d527-4314-89dc-fd6479ce10a5 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:25.291732 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1f6cb432-c1b0-4235-b260-176431ff5e4f req-ea7c52e8-d527-4314-89dc-fd6479ce10a5 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0489302 Nov 24 11:18:25.338144 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1f6cb432-c1b0-4235-b260-176431ff5e4f req-8da17734-98ea-4a3e-ac30-d6bb8b1e9389 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416849 Nov 24 11:18:25.937153 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ef2466f-d45a-4103-9c2c-72911ded53b4 req-b2f54dce-b1c6-4c3b-9f16-bbeafc4fb084 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:25.938711 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7ef2466f-d45a-4103-9c2c-72911ded53b4 req-b2f54dce-b1c6-4c3b-9f16-bbeafc4fb084 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0537708 Nov 24 11:18:26.016415 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-039253ba-6a63-41f6-97a2-c19ee3315853 req-5f0569af-3060-471d-bdcb-b375e861f932 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:26.017886 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-039253ba-6a63-41f6-97a2-c19ee3315853 req-5f0569af-3060-471d-bdcb-b375e861f932 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 946 time: 0.0757303 Nov 24 11:18:26.022426 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7ef2466f-d45a-4103-9c2c-72911ded53b4 req-94b77718-6400-4ac7-9fd9-7f3e966c704d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0719035 Nov 24 11:18:26.066344 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-039253ba-6a63-41f6-97a2-c19ee3315853 req-a4db07a7-8367-4d9e-9f53-1d9074004eb0 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418425 Nov 24 11:18:26.178017 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e7ca1d8-72d1-43dd-97d6-8bf2b0969aa2 req-0b5291af-579e-4828-bf89-34ca1e651b28 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:26.179480 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5e7ca1d8-72d1-43dd-97d6-8bf2b0969aa2 req-0b5291af-579e-4828-bf89-34ca1e651b28 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 947 time: 0.0493753 Nov 24 11:18:26.229665 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5e7ca1d8-72d1-43dd-97d6-8bf2b0969aa2 req-cfb1d7e8-fd24-4dd2-952b-464460f6fc6d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440190 Nov 24 11:18:26.456584 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-414279ed-1932-4461-bcf6-a6e4147eec8d req-a7b9e2d3-1023-4a4e-bf26-55591ce108eb tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:26.458087 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-414279ed-1932-4461-bcf6-a6e4147eec8d req-a7b9e2d3-1023-4a4e-bf26-55591ce108eb tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0509839 Nov 24 11:18:26.504412 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-414279ed-1932-4461-bcf6-a6e4147eec8d req-4612d6a0-c5a3-4183-8307-152a3c5fd72a tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403647 Nov 24 11:18:27.138775 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46071d9e-cf7b-4d7d-98e7-029f7573b9f0 req-2efd866c-e229-43e5-b5b9-a77b117219c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:27.140184 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-46071d9e-cf7b-4d7d-98e7-029f7573b9f0 req-2efd866c-e229-43e5-b5b9-a77b117219c3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0488331 Nov 24 11:18:27.188010 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-46071d9e-cf7b-4d7d-98e7-029f7573b9f0 req-bf35c7ca-7137-45a2-8fff-fbea95cd65ac tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417883 Nov 24 11:18:27.299770 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46ee5482-5852-45d0-9aa3-31e37ce24089 req-489af133-6c0f-4f12-9d1e-95d24ee50cb0 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:27.303953 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-46ee5482-5852-45d0-9aa3-31e37ce24089 req-489af133-6c0f-4f12-9d1e-95d24ee50cb0 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 946 time: 0.0614822 Nov 24 11:18:27.377274 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-46ee5482-5852-45d0-9aa3-31e37ce24089 req-436a79c3-3cd0-4583-9337-3e83445c456e tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0699952 Nov 24 11:18:27.391176 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b27b3d6-8079-423c-9ddb-850277fd3765 req-31994c9a-b367-424d-9145-10a2c9392026 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:27.392656 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3b27b3d6-8079-423c-9ddb-850277fd3765 req-31994c9a-b367-424d-9145-10a2c9392026 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 947 time: 0.0705185 Nov 24 11:18:27.441727 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3b27b3d6-8079-423c-9ddb-850277fd3765 req-7b8dbff9-8a2a-485e-aeda-a3a6857a8d65 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430276 Nov 24 11:18:27.619427 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89bc04aa-b496-4cad-b4e6-1bf8d78dc009 req-543a4856-3602-48ff-90f4-7ab394658956 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:27.621695 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-89bc04aa-b496-4cad-b4e6-1bf8d78dc009 req-543a4856-3602-48ff-90f4-7ab394658956 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0504298 Nov 24 11:18:27.670835 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-89bc04aa-b496-4cad-b4e6-1bf8d78dc009 req-dc519386-007a-4e2d-b56a-0234fe29de8a tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430629 Nov 24 11:18:28.316993 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb385064-0e86-46c0-9db3-258d773dfd42 req-3f03ee1f-51eb-490c-b132-726dc786e470 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:28.318504 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eb385064-0e86-46c0-9db3-258d773dfd42 req-3f03ee1f-51eb-490c-b132-726dc786e470 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0593092 Nov 24 11:18:28.373256 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eb385064-0e86-46c0-9db3-258d773dfd42 req-ace339f3-847e-4b04-b884-f0cad9affc00 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478384 Nov 24 11:18:28.496199 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7528dcb2-e018-4e98-91e0-9d3bf34faa15 req-33332461-2a07-4933-818d-f0b950456e86 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:28.497753 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7528dcb2-e018-4e98-91e0-9d3bf34faa15 req-33332461-2a07-4933-818d-f0b950456e86 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 946 time: 0.0521426 Nov 24 11:18:28.583173 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7528dcb2-e018-4e98-91e0-9d3bf34faa15 req-7840da9c-d331-4890-bff4-cdf61a51cac2 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0793750 Nov 24 11:18:28.584467 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238f982f-48bb-49ea-a0a2-d05b26d543be req-07253e80-1ad6-48b1-9f7b-e7c446c67272 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:28.585933 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-238f982f-48bb-49ea-a0a2-d05b26d543be req-07253e80-1ad6-48b1-9f7b-e7c446c67272 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 946 time: 0.0542231 Nov 24 11:18:28.592122 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb82d5c4-4ebc-4cc3-94f1-b3bf18f9ca63 req-b7c662c9-24eb-4782-a66d-1ac1fb529e5a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:28.593904 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bb82d5c4-4ebc-4cc3-94f1-b3bf18f9ca63 req-b7c662c9-24eb-4782-a66d-1ac1fb529e5a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 947 time: 0.0763638 Nov 24 11:18:28.642055 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bb82d5c4-4ebc-4cc3-94f1-b3bf18f9ca63 req-85dbd11a-4cae-406f-adaf-f61a57157c77 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422449 Nov 24 11:18:28.684537 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-238f982f-48bb-49ea-a0a2-d05b26d543be req-5662391b-638e-4369-9dab-0d4b8ba4cc59 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Deleting port 7041b264-1b4e-4b52-9407-c7681bd79d2b {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:18:28.684875 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-238f982f-48bb-49ea-a0a2-d05b26d543be req-5662391b-638e-4369-9dab-0d4b8ba4cc59 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:28.776150 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-238f982f-48bb-49ea-a0a2-d05b26d543be req-5662391b-638e-4369-9dab-0d4b8ba4cc59 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] For port 7041b264-1b4e-4b52-9407-c7681bd79d2b, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=7041b264-1b4e-4b52-9407-c7681bd79d2b,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:18:28.777047 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-238f982f-48bb-49ea-a0a2-d05b26d543be req-5662391b-638e-4369-9dab-0d4b8ba4cc59 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:28.789247 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-238f982f-48bb-49ea-a0a2-d05b26d543be req-5662391b-638e-4369-9dab-0d4b8ba4cc59 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Calling delete_port for 7041b264-1b4e-4b52-9407-c7681bd79d2b owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:18:28.789467 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44872a94-8e53-4009-b5c6-bf4535f2fbbf req-0ae63d30-f719-4b18-9ccc-9ab71f6763d0 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:28.791002 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-44872a94-8e53-4009-b5c6-bf4535f2fbbf req-0ae63d30-f719-4b18-9ccc-9ab71f6763d0 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0511277 Nov 24 11:18:28.838602 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-44872a94-8e53-4009-b5c6-bf4535f2fbbf req-d730b26b-a073-40d1-ab9d-0f4ac68a1c42 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408840 Nov 24 11:18:29.036268 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-238f982f-48bb-49ea-a0a2-d05b26d543be req-5662391b-638e-4369-9dab-0d4b8ba4cc59 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:29.051906 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['af19a68f-fbb1-4d8c-9034-627d69f6dfd0', '5e1dd2e6-fe77-43bc-98bf-f1a63705734c', '4937438f-b5f9-45ee-9f52-e426878caa7d', '7041b264-1b4e-4b52-9407-c7681bd79d2b'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:18:29.067627 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5662391b-638e-4369-9dab-0d4b8ba4cc59 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Pushing event deleted for resources: {'Port': ['ID=7041b264-1b4e-4b52-9407-c7681bd79d2b,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:29.108936 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-238f982f-48bb-49ea-a0a2-d05b26d543be req-5662391b-638e-4369-9dab-0d4b8ba4cc59 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] No DVR routers for this DVR port 7041b264-1b4e-4b52-9407-c7681bd79d2b on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:18:29.111999 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-238f982f-48bb-49ea-a0a2-d05b26d543be req-5662391b-638e-4369-9dab-0d4b8ba4cc59 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:29.115466 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-238f982f-48bb-49ea-a0a2-d05b26d543be req-5662391b-638e-4369-9dab-0d4b8ba4cc59 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "DELETE /v2.0/ports/7041b264-1b4e-4b52-9407-c7681bd79d2b HTTP/1.1" status: 204 len: 173 time: 0.5215867 Nov 24 11:18:29.115900 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16be8a18-2ef0-4454-952b-aaf5990c5ada', 'name': 'network-vif-deleted', 'tag': '7041b264-1b4e-4b52-9407-c7681bd79d2b'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:18:29.118558 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a619d4e7-56bf-48b6-8d9a-1d38e5a42c8e" -d '{"events": [{"server_uuid": "16be8a18-2ef0-4454-952b-aaf5990c5ada", "name": "network-vif-deleted", "tag": "7041b264-1b4e-4b52-9407-c7681bd79d2b"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:18:29.157025 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:18:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07347fd1-7670-4e06-8cb6-04b286f449f3 x-openstack-request-id: req-07347fd1-7670-4e06-8cb6-04b286f449f3 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:18:29.157519 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16be8a18-2ef0-4454-952b-aaf5990c5ada", "name": "network-vif-deleted", "tag": "7041b264-1b4e-4b52-9407-c7681bd79d2b", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:18:29.157945 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-07347fd1-7670-4e06-8cb6-04b286f449f3 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:18:29.158360 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16be8a18-2ef0-4454-952b-aaf5990c5ada', 'name': 'network-vif-deleted', 'tag': '7041b264-1b4e-4b52-9407-c7681bd79d2b', 'status': 'completed', 'code': 200} Nov 24 11:18:29.496521 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524e5690-304e-43ce-864d-008e06eab90b req-e59f2e08-166f-4d80-aad7-5314bdc56ba5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:29.498007 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-524e5690-304e-43ce-864d-008e06eab90b req-e59f2e08-166f-4d80-aad7-5314bdc56ba5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0539625 Nov 24 11:18:29.547251 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-524e5690-304e-43ce-864d-008e06eab90b req-54b4bae2-6fe1-4a02-a907-1facafc437a2 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427604 Nov 24 11:18:29.691278 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-245ab233-71dd-457c-8dcd-f803a73e825a req-34e7700f-9eda-479a-ab4e-dd7857fa3a55 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=16be8a18-2ef0-4454-952b-aaf5990c5ada HTTP/1.1" status: 200 len: 210 time: 0.0267713 Nov 24 11:18:29.764722 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976be52d-f6bd-4d84-aa6e-f06dd04ed1f2 req-1c27a1f1-e095-428c-bb1c-823d853a7a0d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:29.766196 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-976be52d-f6bd-4d84-aa6e-f06dd04ed1f2 req-1c27a1f1-e095-428c-bb1c-823d853a7a0d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 947 time: 0.0495963 Nov 24 11:18:29.815681 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-976be52d-f6bd-4d84-aa6e-f06dd04ed1f2 req-86cbb4fd-f532-4d1f-9c33-3f1a73842379 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429530 Nov 24 11:18:29.965887 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f9f21ca-e6b2-4365-bebd-91f266bb066d req-64ab57d7-0f24-4250-a9c6-1063f54cad47 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:29.967283 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9f9f21ca-e6b2-4365-bebd-91f266bb066d req-64ab57d7-0f24-4250-a9c6-1063f54cad47 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0560527 Nov 24 11:18:30.014488 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9f9f21ca-e6b2-4365-bebd-91f266bb066d req-f68ca3f2-ceb4-4d4f-affa-70c1888eb6cd tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411046 Nov 24 11:18:30.662108 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b72be004-8383-4151-89bf-6f433549693a req-6b749d45-7d0f-4be0-ac18-d4a738c98761 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:30.663610 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b72be004-8383-4151-89bf-6f433549693a req-6b749d45-7d0f-4be0-ac18-d4a738c98761 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0486765 Nov 24 11:18:30.709663 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b72be004-8383-4151-89bf-6f433549693a req-e42ab31a-fce0-4614-9168-0e3d00cfbea1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401707 Nov 24 11:18:30.934362 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7aee22-0c0b-4ba3-824f-7363ba16e65b req-10bb02c6-bb5a-4447-a524-3174c5af8569 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:30.935947 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eb7aee22-0c0b-4ba3-824f-7363ba16e65b req-10bb02c6-bb5a-4447-a524-3174c5af8569 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 947 time: 0.0488248 Nov 24 11:18:30.989523 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eb7aee22-0c0b-4ba3-824f-7363ba16e65b req-4d8a2fe5-6ac2-4865-bcf7-812a3522baea tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474856 Nov 24 11:18:31.128082 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ef8cd3b-a9e0-40d3-8360-c261c8ce9668 req-3b3653d1-4237-4359-a5a2-0071bb1f8d76 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:31.129562 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3ef8cd3b-a9e0-40d3-8360-c261c8ce9668 req-3b3653d1-4237-4359-a5a2-0071bb1f8d76 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0485513 Nov 24 11:18:31.175721 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3ef8cd3b-a9e0-40d3-8360-c261c8ce9668 req-c1135eb5-d60b-4dc5-8a67-074c9b867dd8 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401819 Nov 24 11:18:31.821909 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ada78b1b-13ca-42ab-a0cf-9fcebd903be2 req-cd58e84c-45b8-4fbf-b1e0-f890978e2ab8 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:31.823471 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ada78b1b-13ca-42ab-a0cf-9fcebd903be2 req-cd58e84c-45b8-4fbf-b1e0-f890978e2ab8 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0485888 Nov 24 11:18:31.870145 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ada78b1b-13ca-42ab-a0cf-9fcebd903be2 req-be634aae-e767-4924-9db9-40a514bac143 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405304 Nov 24 11:18:32.298563 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd5df41-0b5b-4bf9-b869-bcb0918559cf req-e661ab41-bed0-4c06-a6b4-0c628193426c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:32.300020 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2cd5df41-0b5b-4bf9-b869-bcb0918559cf req-e661ab41-bed0-4c06-a6b4-0c628193426c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0547857 Nov 24 11:18:32.352241 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2cd5df41-0b5b-4bf9-b869-bcb0918559cf req-78ffe6df-68c6-47ec-99f6-03ac5e8706e7 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462105 Nov 24 11:18:32.520414 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a4851d-11fa-4ee5-b9a1-e84b777f94ca req-efd95799-a3e3-4e8c-a78a-200614a81134 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:32.521899 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-17a4851d-11fa-4ee5-b9a1-e84b777f94ca req-efd95799-a3e3-4e8c-a78a-200614a81134 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 945 time: 0.0506673 Nov 24 11:18:32.570936 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-17a4851d-11fa-4ee5-b9a1-e84b777f94ca req-6792a221-af2a-4a2b-bc2a-95971801d6dc tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426810 Nov 24 11:18:32.988021 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1163074e-1df2-446c-9b31-de4aeb4b92bb req-bacc7506-2b4a-4fce-9153-0b92b0387544 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:32.989751 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1163074e-1df2-446c-9b31-de4aeb4b92bb req-bacc7506-2b4a-4fce-9153-0b92b0387544 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0512559 Nov 24 11:18:33.039199 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1163074e-1df2-446c-9b31-de4aeb4b92bb req-acbb1138-6e78-4165-a9b7-b6a80e58a3e9 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436285 Nov 24 11:18:33.128535 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 7041b264-1b4e-4b52-9407-c7681bd79d2b no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:18:33.151950 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 7041b264-1b4e-4b52-9407-c7681bd79d2b {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:18:33.152211 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 7041b264-1b4e-4b52-9407-c7681bd79d2b not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:18:33.466896 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0b4d890-04f4-4d7f-9c4f-06b9e8002be4 req-882f88ff-56cf-4700-9066-3f4ab41f808e tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:33.468270 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e0b4d890-04f4-4d7f-9c4f-06b9e8002be4 req-882f88ff-56cf-4700-9066-3f4ab41f808e tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0486970 Nov 24 11:18:33.514511 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e0b4d890-04f4-4d7f-9c4f-06b9e8002be4 req-480736d8-dc9a-497d-bc33-860d3cc6eba7 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403733 Nov 24 11:18:33.686895 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b657f4c-459b-4228-a1e0-0975d8bc4880 req-7e760f13-958c-46c0-ab13-e41d55d26f0f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:33.688373 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8b657f4c-459b-4228-a1e0-0975d8bc4880 req-7e760f13-958c-46c0-ab13-e41d55d26f0f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 945 time: 0.0479519 Nov 24 11:18:33.741553 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8b657f4c-459b-4228-a1e0-0975d8bc4880 req-f70e7e03-916d-47dd-9746-c504034a633f tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414729 Nov 24 11:18:34.157259 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff3b0453-8c2e-49b7-b52a-2b836eaa1820 req-33e60e14-bd8b-40c9-91c8-b302471ff360 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:34.158757 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff3b0453-8c2e-49b7-b52a-2b836eaa1820 req-33e60e14-bd8b-40c9-91c8-b302471ff360 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0529928 Nov 24 11:18:34.208254 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff3b0453-8c2e-49b7-b52a-2b836eaa1820 req-9307dc79-2aba-4bb4-95fa-e7b00cee9c81 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435092 Nov 24 11:18:34.455258 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf83291d-f7c0-4361-b272-71068cad0316 req-35e3ada9-97e3-45fe-a3f4-6e38e8e0ae3a tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:34.456722 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-bf83291d-f7c0-4361-b272-71068cad0316 req-35e3ada9-97e3-45fe-a3f4-6e38e8e0ae3a tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 945 time: 0.0485594 Nov 24 11:18:34.558626 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-bf83291d-f7c0-4361-b272-71068cad0316 req-60aa7f56-528d-49ba-97d2-9a6c749a46a5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Deleting port 4937438f-b5f9-45ee-9f52-e426878caa7d {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:18:34.558962 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-bf83291d-f7c0-4361-b272-71068cad0316 req-60aa7f56-528d-49ba-97d2-9a6c749a46a5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:34.633051 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-531a895f-1535-4a20-989f-79a17afb4171 req-85cf2e02-faef-4e72-bf69-3e7943352cc6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:34.641290 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-531a895f-1535-4a20-989f-79a17afb4171 req-85cf2e02-faef-4e72-bf69-3e7943352cc6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0527263 Nov 24 11:18:34.655892 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-bf83291d-f7c0-4361-b272-71068cad0316 req-60aa7f56-528d-49ba-97d2-9a6c749a46a5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] For port 4937438f-b5f9-45ee-9f52-e426878caa7d, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4937438f-b5f9-45ee-9f52-e426878caa7d,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:18:34.656251 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-bf83291d-f7c0-4361-b272-71068cad0316 req-60aa7f56-528d-49ba-97d2-9a6c749a46a5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:34.669298 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-bf83291d-f7c0-4361-b272-71068cad0316 req-60aa7f56-528d-49ba-97d2-9a6c749a46a5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Calling delete_port for 4937438f-b5f9-45ee-9f52-e426878caa7d owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:18:34.692625 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-531a895f-1535-4a20-989f-79a17afb4171 req-c1f52589-1c47-4808-9c3d-d87842086959 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506966 Nov 24 11:18:34.903655 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead82eb9-cb32-4f6f-a206-d97e5db31695 req-1bc61d14-673a-437f-8b65-29117e565f8a tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:34.905090 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ead82eb9-cb32-4f6f-a206-d97e5db31695 req-1bc61d14-673a-437f-8b65-29117e565f8a tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 945 time: 0.0846159 Nov 24 11:18:34.926719 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-755d8aa4-9463-45fd-b3a1-78a351266233 req-73042f6d-4672-43d8-8e48-99c68179e5c3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:34.928231 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-755d8aa4-9463-45fd-b3a1-78a351266233 req-73042f6d-4672-43d8-8e48-99c68179e5c3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 946 time: 0.0743518 Nov 24 11:18:34.995670 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ead82eb9-cb32-4f6f-a206-d97e5db31695 req-b852a1d8-a8d7-49c3-a98e-75ce259fa3ac tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836267 Nov 24 11:18:35.004080 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-755d8aa4-9463-45fd-b3a1-78a351266233 req-0c687cae-1944-4f49-94da-09013878574a tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663815 Nov 24 11:18:35.029807 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 57986) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:35.087649 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-bf83291d-f7c0-4361-b272-71068cad0316 req-60aa7f56-528d-49ba-97d2-9a6c749a46a5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:35.112151 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['af19a68f-fbb1-4d8c-9034-627d69f6dfd0', '5e1dd2e6-fe77-43bc-98bf-f1a63705734c', '4937438f-b5f9-45ee-9f52-e426878caa7d'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:18:35.125134 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60aa7f56-528d-49ba-97d2-9a6c749a46a5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Pushing event deleted for resources: {'Port': ['ID=4937438f-b5f9-45ee-9f52-e426878caa7d,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:35.182273 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-bf83291d-f7c0-4361-b272-71068cad0316 req-60aa7f56-528d-49ba-97d2-9a6c749a46a5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] No DVR routers for this DVR port 4937438f-b5f9-45ee-9f52-e426878caa7d on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:18:35.186055 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-bf83291d-f7c0-4361-b272-71068cad0316 req-60aa7f56-528d-49ba-97d2-9a6c749a46a5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:35.189367 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-bf83291d-f7c0-4361-b272-71068cad0316 req-60aa7f56-528d-49ba-97d2-9a6c749a46a5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "DELETE /v2.0/ports/4937438f-b5f9-45ee-9f52-e426878caa7d HTTP/1.1" status: 204 len: 173 time: 0.7240014 Nov 24 11:18:35.191216 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1b563a6c-0dc5-4560-941a-74894bab54c5', 'name': 'network-vif-deleted', 'tag': '4937438f-b5f9-45ee-9f52-e426878caa7d'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:18:35.193503 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-20a4c841-0c2b-4bf9-8969-ac6263e802e4" -d '{"events": [{"server_uuid": "1b563a6c-0dc5-4560-941a-74894bab54c5", "name": "network-vif-deleted", "tag": "4937438f-b5f9-45ee-9f52-e426878caa7d"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:18:35.205342 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4fb129ed-727c-4597-99f8-208172166c8a tempest-TestMinimumBasicScenario-1068340022 tempest-TestMinimumBasicScenario-1068340022-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:35.207171 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-4fb129ed-727c-4597-99f8-208172166c8a tempest-TestMinimumBasicScenario-1068340022 tempest-TestMinimumBasicScenario-1068340022-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 1094 time: 0.1761007 Nov 24 11:18:35.210137 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 57992) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:35.214612 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Request body: {'floatingip': {'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'port_id': '57415158-968f-4f63-9c5f-eba02f4dd725', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'fixed_ip_address': '172.20.0.12'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:18:35.233925 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:18:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-687bd508-d346-4551-b9f9-c74bddb9841a x-openstack-request-id: req-687bd508-d346-4551-b9f9-c74bddb9841a {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:18:35.234266 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1b563a6c-0dc5-4560-941a-74894bab54c5", "name": "network-vif-deleted", "tag": "4937438f-b5f9-45ee-9f52-e426878caa7d", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:18:35.234583 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-687bd508-d346-4551-b9f9-c74bddb9841a {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:18:35.234872 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1b563a6c-0dc5-4560-941a-74894bab54c5', 'name': 'network-vif-deleted', 'tag': '4937438f-b5f9-45ee-9f52-e426878caa7d', 'status': 'completed', 'code': 200} Nov 24 11:18:35.329566 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a661f40f-7d7c-4132-a44c-2ddbaae4e67f req-7e5678ee-2776-49bb-8863-8035dabe6777 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:35.331064 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a661f40f-7d7c-4132-a44c-2ddbaae4e67f req-7e5678ee-2776-49bb-8863-8035dabe6777 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0532529 Nov 24 11:18:35.378843 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for floatingip, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:35.385345 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a661f40f-7d7c-4132-a44c-2ddbaae4e67f req-a8b9c8d1-8ea4-4ce1-9d68-d89e2cca6c23 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481064 Nov 24 11:18:35.476921 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:35.583734 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Allocated IP 172.27.3.144 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/d07b8672-13e9-44a3-874b-8468b25e89d2) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:18:35.681704 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:35.756551 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:35.830973 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:18:35.833877 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event updated for resources: {'Port': ['ID=d07b8672-13e9-44a3-874b-8468b25e89d2,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:35.838260 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:18:35.841140 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:18:35.865635 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:35.865635 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:35.865937 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:35.867095 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:35.867095 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:35.867095 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:35.867408 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:35.867592 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:35.867880 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:35.868167 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:35.868750 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:35.868863 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:18:35.897627 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ae40ba0-4b33-49ea-ae81-f9145064eabf req-b625269f-ac08-429c-88fb-0b8f622f2e93 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:35.899082 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8ae40ba0-4b33-49ea-ae81-f9145064eabf req-b625269f-ac08-429c-88fb-0b8f622f2e93 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.1345010 Nov 24 11:18:36.003038 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8ae40ba0-4b33-49ea-ae81-f9145064eabf req-d1bba090-6ba8-43c3-9b6d-fa67c39202a2 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0962455 Nov 24 11:18:36.119092 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-955dd644-c2b6-4969-aed0-a5432b5b298b req-b09c44d2-95da-40dd-bdd6-2f22b0c9a582 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1b563a6c-0dc5-4560-941a-74894bab54c5 HTTP/1.1" status: 200 len: 210 time: 0.0273206 Nov 24 11:18:36.284524 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:36.410917 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:36.561167 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cccfa13d-5580-421e-81aa-09062395637f req-dd681021-2150-48b9-99b9-f7e8f358dfe3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:36.562541 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cccfa13d-5580-421e-81aa-09062395637f req-dd681021-2150-48b9-99b9-f7e8f358dfe3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.1006031 Nov 24 11:18:36.636963 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for port, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:36.641754 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cccfa13d-5580-421e-81aa-09062395637f req-b2d11f83-7885-41f6-a60f-afcc0d325f20 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0733457 Nov 24 11:18:36.682001 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8699083'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:36.750790 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event updated for resources: {'Port': ['ID=d07b8672-13e9-44a3-874b-8468b25e89d2,revision_number=2']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:36.760515 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:36.860835 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.l3_db [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Floating IP 8aaa7db5-e2b2-4460-a574-914da19b8aea associated. External IP: 172.27.3.144, port: 57415158-968f-4f63-9c5f-eba02f4dd725. Nov 24 11:18:37.009240 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9613a28-b0cc-4699-bfd8-cd878b5b5cdc req-26c7304a-9c81-4ce1-8934-a608f7385258 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:37.010698 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b9613a28-b0cc-4699-bfd8-cd878b5b5cdc req-26c7304a-9c81-4ce1-8934-a608f7385258 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0670874 Nov 24 11:18:37.080692 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2b2b515-95d4-4238-8405-311f9a075ab5 req-7dc4de0d-332b-479a-9760-0b3ec0da47d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:37.082301 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c2b2b515-95d4-4238-8405-311f9a075ab5 req-7dc4de0d-332b-479a-9760-0b3ec0da47d9 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=907128185ff9473381be53050d202838&device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 1098 time: 0.0436134 Nov 24 11:18:37.124791 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 4937438f-b5f9-45ee-9f52-e426878caa7d no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:18:37.145870 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 4937438f-b5f9-45ee-9f52-e426878caa7d {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:18:37.146326 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 4937438f-b5f9-45ee-9f52-e426878caa7d not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:18:37.160574 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b9613a28-b0cc-4699-bfd8-cd878b5b5cdc req-c4f26e8a-f220-4119-b13b-c7e4710c3471 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1177976 Nov 24 11:18:37.189897 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe3f0ce-7b03-47f3-bac0-64a2df63242c req-ee6fd33f-8585-4f19-a813-5d50b43706fc tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:37.192105 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dbe3f0ce-7b03-47f3-bac0-64a2df63242c req-ee6fd33f-8585-4f19-a813-5d50b43706fc tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0877995 Nov 24 11:18:37.193224 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2b2b515-95d4-4238-8405-311f9a075ab5 req-bc31efb3-e7bc-420f-a99c-4e342a7d3598 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:37.194657 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c2b2b515-95d4-4238-8405-311f9a075ab5 req-bc31efb3-e7bc-420f-a99c-4e342a7d3598 service neutron] 10.222.0.86 "GET /v2.0/networks?id=d9d87ca8-7863-48a6-937c-ee712996776e HTTP/1.1" status: 200 len: 913 time: 0.0982959 Nov 24 11:18:37.195578 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Router 0d8adae3-0d48-4940-84b4-9800d498d230 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:18:37.264808 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c2b2b515-95d4-4238-8405-311f9a075ab5 req-ccd2e69e-2824-4999-af7e-a0fe765a779d service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa HTTP/1.1" status: 200 len: 1001 time: 0.0616543 Nov 24 11:18:37.317110 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2b2b515-95d4-4238-8405-311f9a075ab5 req-d97b7615-6240-41ba-be89-e670e0b38ff9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:37.318675 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c2b2b515-95d4-4238-8405-311f9a075ab5 req-d97b7615-6240-41ba-be89-e670e0b38ff9 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c0d420cf-0b8e-4f90-a25c-9a74e1eafabb HTTP/1.1" status: 200 len: 850 time: 0.0455287 Nov 24 11:18:37.323563 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dbe3f0ce-7b03-47f3-bac0-64a2df63242c req-878f44c8-9a28-4d09-9fde-807c07c31d9f tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1217957 Nov 24 11:18:37.349257 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:18:37.362451 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0a57529-18ed-4ab1-976f-f6f38400df0e None None] Sync routers for ids ['0d8adae3-0d48-4940-84b4-9800d498d230'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:18:37.375846 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0a57529-18ed-4ab1-976f-f6f38400df0e None None] Routers {'0d8adae3-0d48-4940-84b4-9800d498d230'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:18:37.376461 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-a0a57529-18ed-4ab1-976f-f6f38400df0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:18:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['0d8adae3-0d48-4940-84b4-9800d498d230'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:18:37.380187 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2b2b515-95d4-4238-8405-311f9a075ab5 req-ddd4274f-fca6-4933-8940-b6969d4d306a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:37.381715 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c2b2b515-95d4-4238-8405-311f9a075ab5 req-ddd4274f-fca6-4933-8940-b6969d4d306a service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=d9d87ca8-7863-48a6-937c-ee712996776e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0556378 Nov 24 11:18:37.482807 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c2b2b515-95d4-4238-8405-311f9a075ab5 req-90c45d66-19b0-4d62-9d74-e8c4e12b8fe5 service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0931861 Nov 24 11:18:37.486414 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-a0a57529-18ed-4ab1-976f-f6f38400df0e None None] Set router 0d8adae3-0d48-4940-84b4-9800d498d230 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:18:37.589695 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c2b2b515-95d4-4238-8405-311f9a075ab5 req-15938446-fcc5-4429-a764-75ee7a1bf1ff service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1000783 Nov 24 11:18:37.656727 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:37.683989 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2b2ab40d-9c67-44ce-8293-3600b6da8f5f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.4726582 Nov 24 11:18:37.684650 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:18:37.687135 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7339394f-1e85-4e6e-a84e-3942fe151ac1" -d '{"events": [{"name": "network-changed", "server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:18:37.687333 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58012) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:37.691849 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-934dbcb8-7794-43e3-be3e-05c02332d31e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-122985791', 'description': 'tempest-secgroup-smoke-122985791 description', 'project_id': '41b5f46d34ad4033a154a9afabe2091f'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:18:37.729348 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:18:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-59cef03c-3ece-4fd4-8aa4-04605850574e x-openstack-request-id: req-59cef03c-3ece-4fd4-8aa4-04605850574e {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:18:37.729632 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:18:37.729878 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-59cef03c-3ece-4fd4-8aa4-04605850574e {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:18:37.730281 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725', 'status': 'completed', 'code': 200} Nov 24 11:18:37.741004 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-a0a57529-18ed-4ab1-976f-f6f38400df0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:17:33Z', 'revision_number': 4, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '8aaa7db5-e2b2-4460-a574-914da19b8aea', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'floating_ip_address': '172.27.3.144', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'port_id': '57415158-968f-4f63-9c5f-eba02f4dd725', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 378, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'mac_address': 'fa:16:3e:ad:76:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:18:36Z', 'updated_at': '2021-11-24T11:18:36Z', 'revision_number': 0, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3c193dd0-ad65-44b5-b059-da55dd5857b0', 'name': '', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'mac_address': 'fa:16:3e:0f:1e:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:33Z', 'updated_at': '2021-11-24T11:17:38Z', 'revision_number': 5, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'subnets': [{'id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:18:37.767037 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0a57529-18ed-4ab1-976f-f6f38400df0e None None] Checking router: 0d8adae3-0d48-4940-84b4-9800d498d230 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:18:37.783185 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0a57529-18ed-4ab1-976f-f6f38400df0e None None] Routers {'0d8adae3-0d48-4940-84b4-9800d498d230'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:18:37.783986 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-a0a57529-18ed-4ab1-976f-f6f38400df0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:18:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['0d8adae3-0d48-4940-84b4-9800d498d230'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:18:37.806906 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7339394f-1e85-4e6e-a84e-3942fe151ac1 req-1ba90ce3-3cb7-4938-8ac2-17c553c50cf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:37.808482 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7339394f-1e85-4e6e-a84e-3942fe151ac1 req-1ba90ce3-3cb7-4938-8ac2-17c553c50cf8 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=41b5f46d34ad4033a154a9afabe2091f&device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 1099 time: 0.0535684 Nov 24 11:18:37.896795 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-a0a57529-18ed-4ab1-976f-f6f38400df0e None None] Set router 0d8adae3-0d48-4940-84b4-9800d498d230 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:18:37.917217 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7339394f-1e85-4e6e-a84e-3942fe151ac1 req-4d5b7992-3f7d-4019-969c-cd00b8e5d0d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:37.919271 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7339394f-1e85-4e6e-a84e-3942fe151ac1 req-4d5b7992-3f7d-4019-969c-cd00b8e5d0d5 service neutron] 10.222.0.86 "GET /v2.0/networks?id=c3a531f2-bfe9-4a80-8b71-ad7f35944879 HTTP/1.1" status: 200 len: 917 time: 0.0974283 Nov 24 11:18:37.995339 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7339394f-1e85-4e6e-a84e-3942fe151ac1 req-21e13992-941c-4a3f-87ab-527b98cd19d4 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=57415158-968f-4f63-9c5f-eba02f4dd725 HTTP/1.1" status: 200 len: 1000 time: 0.0682724 Nov 24 11:18:38.052074 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7339394f-1e85-4e6e-a84e-3942fe151ac1 req-11bdf336-f425-4159-96bc-0691575c10e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:38.053536 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7339394f-1e85-4e6e-a84e-3942fe151ac1 req-11bdf336-f425-4159-96bc-0691575c10e3 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=08393eb4-7b60-4211-937a-8e0724891dbc HTTP/1.1" status: 200 len: 854 time: 0.0446849 Nov 24 11:18:38.109688 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7339394f-1e85-4e6e-a84e-3942fe151ac1 req-327f73dd-bcaf-4cd0-9237-cf3627532124 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:38.111170 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7339394f-1e85-4e6e-a84e-3942fe151ac1 req-327f73dd-bcaf-4cd0-9237-cf3627532124 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=c3a531f2-bfe9-4a80-8b71-ad7f35944879&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0447147 Nov 24 11:18:38.144932 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-a0a57529-18ed-4ab1-976f-f6f38400df0e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:17:33Z', 'revision_number': 4, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '8aaa7db5-e2b2-4460-a574-914da19b8aea', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'floating_ip_address': '172.27.3.144', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'port_id': '57415158-968f-4f63-9c5f-eba02f4dd725', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 378, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'mac_address': 'fa:16:3e:ad:76:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:18:36Z', 'updated_at': '2021-11-24T11:18:36Z', 'revision_number': 0, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3c193dd0-ad65-44b5-b059-da55dd5857b0', 'name': '', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'mac_address': 'fa:16:3e:0f:1e:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:33Z', 'updated_at': '2021-11-24T11:17:38Z', 'revision_number': 5, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'subnets': [{'id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:18:38.176709 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0a57529-18ed-4ab1-976f-f6f38400df0e None None] The sync data for ids ['0d8adae3-0d48-4940-84b4-9800d498d230'] in dv-cinder-804035-18-iscsi is: [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:17:33Z', 'revision_number': 4, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '8aaa7db5-e2b2-4460-a574-914da19b8aea', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'floating_ip_address': '172.27.3.144', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'port_id': '57415158-968f-4f63-9c5f-eba02f4dd725', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 378, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'mac_address': 'fa:16:3e:ad:76:17', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:18:36Z', 'updated_at': '2021-11-24T11:18:36Z', 'revision_number': 0, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '3c193dd0-ad65-44b5-b059-da55dd5857b0', 'name': '', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'mac_address': 'fa:16:3e:0f:1e:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:33Z', 'updated_at': '2021-11-24T11:17:38Z', 'revision_number': 5, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'subnets': [{'id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:18:38.210949 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7339394f-1e85-4e6e-a84e-3942fe151ac1 req-8bcfd54e-36b0-4492-88d3-794c2d996335 service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0896010 Nov 24 11:18:38.294657 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b70cbdb8-3b9f-41a2-887d-a2b8d2c7cb29 req-f681d300-2b3c-4b51-8752-be5c89a2b404 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:38.296167 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b70cbdb8-3b9f-41a2-887d-a2b8d2c7cb29 req-f681d300-2b3c-4b51-8752-be5c89a2b404 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0558295 Nov 24 11:18:38.313910 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7339394f-1e85-4e6e-a84e-3942fe151ac1 req-8764bb18-fb87-4174-a4c9-795f35ce8688 service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0945814 Nov 24 11:18:38.332843 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-934dbcb8-7794-43e3-be3e-05c02332d31e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:38.384667 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b70cbdb8-3b9f-41a2-887d-a2b8d2c7cb29 req-f0aa9c6b-361b-4044-b7d1-04d50d0f2240 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0821581 Nov 24 11:18:38.422925 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f982917-8960-4ea2-9708-1ec7b5409ca8 None None] New status for floating IP 8aaa7db5-e2b2-4460-a574-914da19b8aea: ACTIVE {{(pid=103245) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:18:38.435560 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-934dbcb8-7794-43e3-be3e-05c02332d31e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:38.539232 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-934dbcb8-7794-43e3-be3e-05c02332d31e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:38.574593 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-934dbcb8-7794-43e3-be3e-05c02332d31e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3447b729-9871-4ac1-9faf-bf8884defce7,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:38.638784 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-934dbcb8-7794-43e3-be3e-05c02332d31e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:38.640226 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-934dbcb8-7794-43e3-be3e-05c02332d31e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.9520719 Nov 24 11:18:38.643100 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58022) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:38.647608 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-6f528826-e2d8-443c-93fc-bfeb0b2f0f1e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Request body: {'security_group_rule': {'security_group_id': '3447b729-9871-4ac1-9faf-bf8884defce7', 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:18:38.711207 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e997fa2-f88d-49a3-a2f2-9eefbc380922 req-ace7735b-f0bc-446f-b923-36ce66873606 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:38.712696 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8e997fa2-f88d-49a3-a2f2-9eefbc380922 req-ace7735b-f0bc-446f-b923-36ce66873606 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 946 time: 0.3155215 Nov 24 11:18:38.733134 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6f528826-e2d8-443c-93fc-bfeb0b2f0f1e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:38.747908 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58269441-99dc-4e22-ae75-72fbb65c447f req-1c42c8ad-307c-4163-b9b6-8fc5a3e837a1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:38.749378 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-58269441-99dc-4e22-ae75-72fbb65c447f req-1c42c8ad-307c-4163-b9b6-8fc5a3e837a1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0754480 Nov 24 11:18:38.756470 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c5e62c94-85f1-4cc9-a4a7-7ead8dbd3a5d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:38.788567 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8e997fa2-f88d-49a3-a2f2-9eefbc380922 req-22e4db28-56f1-4399-96c6-9e1a508bcd25 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693767 Nov 24 11:18:38.809893 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6f528826-e2d8-443c-93fc-bfeb0b2f0f1e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:38.817988 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-58269441-99dc-4e22-ae75-72fbb65c447f req-7ed1b8c0-44c0-4dbb-9bce-bf0ee81a146c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589278 Nov 24 11:18:38.893270 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6f528826-e2d8-443c-93fc-bfeb0b2f0f1e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:38.910859 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f528826-e2d8-443c-93fc-bfeb0b2f0f1e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e81acfa5-5f5e-4116-a5a7-733be7660a6c,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:38.969440 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6f528826-e2d8-443c-93fc-bfeb0b2f0f1e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:38.970673 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-6f528826-e2d8-443c-93fc-bfeb0b2f0f1e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3265777 Nov 24 11:18:38.973373 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58024) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:38.977738 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-61881316-cce8-40fb-8bb7-8e360dec3794 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Request body: {'security_group_rule': {'security_group_id': '3447b729-9871-4ac1-9faf-bf8884defce7', 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:18:39.092033 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-61881316-cce8-40fb-8bb7-8e360dec3794 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.150449 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.150747 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-61881316-cce8-40fb-8bb7-8e360dec3794 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.225291 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-61881316-cce8-40fb-8bb7-8e360dec3794 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.245284 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61881316-cce8-40fb-8bb7-8e360dec3794 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8408d166-b266-4d9c-addf-86fe59804c03,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:39.299595 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-61881316-cce8-40fb-8bb7-8e360dec3794 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.300779 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-61881316-cce8-40fb-8bb7-8e360dec3794 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3264837 Nov 24 11:18:39.303472 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58026) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:39.307665 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-0c9659f2-e353-44b0-9210-01fb21d1bab2 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Request body: {'security_group_rule': {'security_group_id': '3447b729-9871-4ac1-9faf-bf8884defce7', 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:18:39.382203 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0c9659f2-e353-44b0-9210-01fb21d1bab2 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.442166 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0c9659f2-e353-44b0-9210-01fb21d1bab2 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.492253 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ca9f12-b079-43c9-befb-f58b297bbe8d req-9bfa0c2d-d408-45dc-a6e1-a601117fb5fb tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:39.493620 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-07ca9f12-b079-43c9-befb-f58b297bbe8d req-9bfa0c2d-d408-45dc-a6e1-a601117fb5fb tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0502081 Nov 24 11:18:39.504853 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0c9659f2-e353-44b0-9210-01fb21d1bab2 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.522806 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c9659f2-e353-44b0-9210-01fb21d1bab2 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=97251e5f-b5cb-483c-a9e1-428e0d3a002a,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:39.545374 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-07ca9f12-b079-43c9-befb-f58b297bbe8d req-feddae7d-fb42-4776-a555-1e605b113682 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458496 Nov 24 11:18:39.598346 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0c9659f2-e353-44b0-9210-01fb21d1bab2 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.599581 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-0c9659f2-e353-44b0-9210-01fb21d1bab2 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2951896 Nov 24 11:18:39.602378 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58032) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:39.606820 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-8a4a5366-e73d-4ca7-b57e-7fbe66503185 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Request body: {'security_group_rule': {'security_group_id': '3447b729-9871-4ac1-9faf-bf8884defce7', 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:18:39.693239 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8a4a5366-e73d-4ca7-b57e-7fbe66503185 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.754722 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8a4a5366-e73d-4ca7-b57e-7fbe66503185 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.829810 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8a4a5366-e73d-4ca7-b57e-7fbe66503185 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.844481 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a4a5366-e73d-4ca7-b57e-7fbe66503185 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f6f32fc5-77df-408a-bd09-8f27aee02197,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:39.930347 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8a4a5366-e73d-4ca7-b57e-7fbe66503185 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:39.931603 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-8a4a5366-e73d-4ca7-b57e-7fbe66503185 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3282647 Nov 24 11:18:39.934674 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58038) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:39.938421 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a3c3f86-cfad-4e69-a364-733445ab4953 req-088ce935-e7b0-42bd-ba59-c8d844544454 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:39.939684 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-c39e4440-19e3-47cb-ad0e-9efa392c544e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Request body: {'security_group_rule': {'security_group_id': '3447b729-9871-4ac1-9faf-bf8884defce7', 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:18:39.939926 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0a3c3f86-cfad-4e69-a364-733445ab4953 req-088ce935-e7b0-42bd-ba59-c8d844544454 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 946 time: 0.0775983 Nov 24 11:18:39.953162 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-467e400e-479d-4bbd-ac38-b86cc5ec56ee req-59f44114-a029-4742-bc96-832ed7f3ca8c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:39.958625 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-467e400e-479d-4bbd-ac38-b86cc5ec56ee req-59f44114-a029-4742-bc96-832ed7f3ca8c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0660608 Nov 24 11:18:40.027225 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0a3c3f86-cfad-4e69-a364-733445ab4953 req-b2072a9a-9e94-4b05-a2b5-0758dc1cf13b tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712788 Nov 24 11:18:40.034356 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-467e400e-479d-4bbd-ac38-b86cc5ec56ee req-13ac0e5c-316c-42e1-8c5f-f8e16aa0e94d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0719657 Nov 24 11:18:40.036178 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.securitygroups_db [None req-c39e4440-19e3-47cb-ad0e-9efa392c544e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Project 41b5f46d34ad4033a154a9afabe2091f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 11:18:40.048320 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c39e4440-19e3-47cb-ad0e-9efa392c544e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:40.056029 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:18:40.137895 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-811dacd3-51b6-42da-89ed-76cd061764bb req-6bdac842-c399-46d0-b932-49d029701464 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:40.140034 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-811dacd3-51b6-42da-89ed-76cd061764bb req-6bdac842-c399-46d0-b932-49d029701464 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 946 time: 0.0718334 Nov 24 11:18:40.145375 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c39e4440-19e3-47cb-ad0e-9efa392c544e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:40.211406 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c39e4440-19e3-47cb-ad0e-9efa392c544e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:40.235887 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c39e4440-19e3-47cb-ad0e-9efa392c544e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=77ff2713-90bf-4d83-a45f-365a42197e32,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:40.255681 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-811dacd3-51b6-42da-89ed-76cd061764bb req-be34aed8-69c7-4149-9df3-51feb4c711ee tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Deleting port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:18:40.256011 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-811dacd3-51b6-42da-89ed-76cd061764bb req-be34aed8-69c7-4149-9df3-51feb4c711ee tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:40.320353 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c39e4440-19e3-47cb-ad0e-9efa392c544e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:40.321439 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-c39e4440-19e3-47cb-ad0e-9efa392c544e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3853090 Nov 24 11:18:40.324146 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58040) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:40.330234 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-7d375c8e-0aec-4e1e-8cdb-9fd392280771 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Request body: {'security_group_rule': {'security_group_id': '3447b729-9871-4ac1-9faf-bf8884defce7', 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:18:40.366861 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-811dacd3-51b6-42da-89ed-76cd061764bb req-be34aed8-69c7-4149-9df3-51feb4c711ee tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] For port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=5e1dd2e6-fe77-43bc-98bf-f1a63705734c,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:18:40.367212 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-811dacd3-51b6-42da-89ed-76cd061764bb req-be34aed8-69c7-4149-9df3-51feb4c711ee tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:40.379645 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-811dacd3-51b6-42da-89ed-76cd061764bb req-be34aed8-69c7-4149-9df3-51feb4c711ee tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Calling delete_port for 5e1dd2e6-fe77-43bc-98bf-f1a63705734c owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:18:40.433372 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.securitygroups_db [None req-7d375c8e-0aec-4e1e-8cdb-9fd392280771 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Project 41b5f46d34ad4033a154a9afabe2091f added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 11:18:40.440675 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d375c8e-0aec-4e1e-8cdb-9fd392280771 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:40.546050 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d375c8e-0aec-4e1e-8cdb-9fd392280771 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:40.618714 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d375c8e-0aec-4e1e-8cdb-9fd392280771 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:40.636648 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d375c8e-0aec-4e1e-8cdb-9fd392280771 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=531f9095-0b8c-4af8-986b-765cfaf0b1df,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:40.664497 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-811dacd3-51b6-42da-89ed-76cd061764bb req-be34aed8-69c7-4149-9df3-51feb4c711ee tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:40.677770 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['af19a68f-fbb1-4d8c-9034-627d69f6dfd0', '5e1dd2e6-fe77-43bc-98bf-f1a63705734c'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:18:40.696403 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d375c8e-0aec-4e1e-8cdb-9fd392280771 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:40.701931 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-7d375c8e-0aec-4e1e-8cdb-9fd392280771 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3726151 Nov 24 11:18:40.701931 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be34aed8-69c7-4149-9df3-51feb4c711ee tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Pushing event deleted for resources: {'Port': ['ID=5e1dd2e6-fe77-43bc-98bf-f1a63705734c,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:40.753631 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-811dacd3-51b6-42da-89ed-76cd061764bb req-be34aed8-69c7-4149-9df3-51feb4c711ee tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] No DVR routers for this DVR port 5e1dd2e6-fe77-43bc-98bf-f1a63705734c on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:18:40.756406 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-811dacd3-51b6-42da-89ed-76cd061764bb req-be34aed8-69c7-4149-9df3-51feb4c711ee tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:40.760005 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-811dacd3-51b6-42da-89ed-76cd061764bb req-be34aed8-69c7-4149-9df3-51feb4c711ee tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "DELETE /v2.0/ports/5e1dd2e6-fe77-43bc-98bf-f1a63705734c HTTP/1.1" status: 204 len: 173 time: 0.6086955 Nov 24 11:18:40.760482 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1451c900-3066-4ab6-a01e-7abc8ed53cfc', 'name': 'network-vif-deleted', 'tag': '5e1dd2e6-fe77-43bc-98bf-f1a63705734c'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:18:40.762889 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-903a2e44-9b9a-4f2a-9696-ab66bd2b9edc" -d '{"events": [{"server_uuid": "1451c900-3066-4ab6-a01e-7abc8ed53cfc", "name": "network-vif-deleted", "tag": "5e1dd2e6-fe77-43bc-98bf-f1a63705734c"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:18:40.824128 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:18:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8121441-c657-43e1-94e6-50a8870915f7 x-openstack-request-id: req-a8121441-c657-43e1-94e6-50a8870915f7 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:18:40.824460 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1451c900-3066-4ab6-a01e-7abc8ed53cfc", "name": "network-vif-deleted", "tag": "5e1dd2e6-fe77-43bc-98bf-f1a63705734c", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:18:40.824716 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-a8121441-c657-43e1-94e6-50a8870915f7 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:18:40.825746 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1451c900-3066-4ab6-a01e-7abc8ed53cfc', 'name': 'network-vif-deleted', 'tag': '5e1dd2e6-fe77-43bc-98bf-f1a63705734c', 'status': 'completed', 'code': 200} Nov 24 11:18:40.838430 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f49aee74-615e-499c-bafe-07dd0e54f0e0 req-b10b4cfc-803e-4a09-8bc8-2282d73ab51b tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-122985791&fields=id&tenant_id=41b5f46d34ad4033a154a9afabe2091f HTTP/1.1" status: 200 len: 267 time: 0.0746090 Nov 24 11:18:40.894664 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f49aee74-615e-499c-bafe-07dd0e54f0e0 req-d247f9f3-4b33-41db-a043-2269a6985785 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:40.896438 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f49aee74-615e-499c-bafe-07dd0e54f0e0 req-d247f9f3-4b33-41db-a043-2269a6985785 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 946 time: 0.0487175 Nov 24 11:18:40.908329 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [req-f49aee74-615e-499c-bafe-07dd0e54f0e0 req-568e9aaa-6fbc-498f-8304-1a8824aba879 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Request body: {'port': {'security_groups': ['77852028-b8f9-4fe3-8362-a7373cc59d6b', '3447b729-9871-4ac1-9faf-bf8884defce7']}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:18:40.973870 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-f49aee74-615e-499c-bafe-07dd0e54f0e0 req-568e9aaa-6fbc-498f-8304-1a8824aba879 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:41.156559 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fc385f09-78c3-47c2-b722-63d31d76ca9e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:41.165453 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fee6d999-5c75-47c6-9796-812afac7b9a3 req-21fe3e23-7542-4aad-a81b-0541a8841171 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=1451c900-3066-4ab6-a01e-7abc8ed53cfc HTTP/1.1" status: 200 len: 210 time: 0.0558262 Nov 24 11:18:41.194109 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [req-f49aee74-615e-499c-bafe-07dd0e54f0e0 req-568e9aaa-6fbc-498f-8304-1a8824aba879 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] For port 57415158-968f-4f63-9c5f-eba02f4dd725, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=57415158-968f-4f63-9c5f-eba02f4dd725,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:18:41.224589 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-f49aee74-615e-499c-bafe-07dd0e54f0e0 req-568e9aaa-6fbc-498f-8304-1a8824aba879 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for port, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:41.275129 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-467230a1-c32a-43b7-b662-cb54221c2f50 req-94d88410-35f1-421d-a92f-10df9c499f6d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:41.276662 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-467230a1-c32a-43b7-b662-cb54221c2f50 req-94d88410-35f1-421d-a92f-10df9c499f6d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0501449 Nov 24 11:18:41.313326 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-f49aee74-615e-499c-bafe-07dd0e54f0e0 req-568e9aaa-6fbc-498f-8304-1a8824aba879 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8699083'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:41.325050 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['57415158-968f-4f63-9c5f-eba02f4dd725'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:18:41.359999 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-467230a1-c32a-43b7-b662-cb54221c2f50 req-53ce74fe-a7e1-4834-91ad-f185c701b140 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0767155 Nov 24 11:18:41.374655 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f49aee74-615e-499c-bafe-07dd0e54f0e0 req-568e9aaa-6fbc-498f-8304-1a8824aba879 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:41.375418 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-f49aee74-615e-499c-bafe-07dd0e54f0e0 req-568e9aaa-6fbc-498f-8304-1a8824aba879 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:41.376845 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f49aee74-615e-499c-bafe-07dd0e54f0e0 req-568e9aaa-6fbc-498f-8304-1a8824aba879 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "PUT /v2.0/ports/57415158-968f-4f63-9c5f-eba02f4dd725 HTTP/1.1" status: 200 len: 982 time: 0.4736094 Nov 24 11:18:41.377314 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:18:41.379689 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-806f6aa1-9e27-4da1-b8af-6f56ad18cdb4" -d '{"events": [{"name": "network-changed", "server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:18:41.400271 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-568e9aaa-6fbc-498f-8304-1a8824aba879 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event updated for resources: {'Port': ['ID=57415158-968f-4f63-9c5f-eba02f4dd725,revision_number=6']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:41.432525 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:18:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91d27787-fe8d-4bf1-9c33-69cc5d37d26e x-openstack-request-id: req-91d27787-fe8d-4bf1-9c33-69cc5d37d26e {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:18:41.433583 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:18:41.433995 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-91d27787-fe8d-4bf1-9c33-69cc5d37d26e {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:18:41.434713 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725', 'status': 'completed', 'code': 200} Nov 24 11:18:41.525914 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806f6aa1-9e27-4da1-b8af-6f56ad18cdb4 req-bd5c15bc-228e-4ef5-b961-bed86bfa2427 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:41.527533 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-806f6aa1-9e27-4da1-b8af-6f56ad18cdb4 req-bd5c15bc-228e-4ef5-b961-bed86bfa2427 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=41b5f46d34ad4033a154a9afabe2091f&device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 1138 time: 0.0577245 Nov 24 11:18:41.545461 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567d0bce-8de2-4d7f-94ef-d86984b3d515 req-f47a817c-4412-46a5-a29c-0c10e24711bb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:41.553187 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-567d0bce-8de2-4d7f-94ef-d86984b3d515 req-f47a817c-4412-46a5-a29c-0c10e24711bb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0827444 Nov 24 11:18:41.571247 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['57415158-968f-4f63-9c5f-eba02f4dd725'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:18:41.641765 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-567d0bce-8de2-4d7f-94ef-d86984b3d515 req-f4b61f0e-7797-421f-80c9-e5d52fd5f2bc tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0876503 Nov 24 11:18:41.671045 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806f6aa1-9e27-4da1-b8af-6f56ad18cdb4 req-e7437089-c775-49f0-b7f1-4d74670a3525 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:41.672418 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-806f6aa1-9e27-4da1-b8af-6f56ad18cdb4 req-e7437089-c775-49f0-b7f1-4d74670a3525 service neutron] 10.222.0.86 "GET /v2.0/networks?id=c3a531f2-bfe9-4a80-8b71-ad7f35944879 HTTP/1.1" status: 200 len: 917 time: 0.1330090 Nov 24 11:18:41.744806 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-806f6aa1-9e27-4da1-b8af-6f56ad18cdb4 req-3f23a547-4ec0-4f8c-93ea-e071f32aef47 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=57415158-968f-4f63-9c5f-eba02f4dd725 HTTP/1.1" status: 200 len: 1002 time: 0.0631735 Nov 24 11:18:41.801876 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806f6aa1-9e27-4da1-b8af-6f56ad18cdb4 req-961e2cd9-eea3-4f8b-9777-732f12c1a124 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:41.803399 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-806f6aa1-9e27-4da1-b8af-6f56ad18cdb4 req-961e2cd9-eea3-4f8b-9777-732f12c1a124 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=08393eb4-7b60-4211-937a-8e0724891dbc HTTP/1.1" status: 200 len: 854 time: 0.0516710 Nov 24 11:18:41.809304 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-a4c83eda-43ec-474f-b250-51acdb2a074f None None] Provisioning complete for port 57415158-968f-4f63-9c5f-eba02f4dd725 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:18:41.809936 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-a4c83eda-43ec-474f-b250-51acdb2a074f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:41.851229 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-806f6aa1-9e27-4da1-b8af-6f56ad18cdb4 req-4eaf22ef-4b67-478b-8e18-2b576164dd16 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:41.852747 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-806f6aa1-9e27-4da1-b8af-6f56ad18cdb4 req-4eaf22ef-4b67-478b-8e18-2b576164dd16 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=c3a531f2-bfe9-4a80-8b71-ad7f35944879&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0414596 Nov 24 11:18:41.950208 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-806f6aa1-9e27-4da1-b8af-6f56ad18cdb4 req-d3414c87-a2a1-4931-8115-59191bf03a6b service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880468 Nov 24 11:18:42.039233 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-806f6aa1-9e27-4da1-b8af-6f56ad18cdb4 req-2fcfede0-4c1a-43a2-a82b-90a57ffd4eee service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818882 Nov 24 11:18:42.425104 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:42.497287 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1d92ce5-bc39-48f6-b896-4f6c8a27350b req-8922a5d1-ea36-44bd-9d57-55c3dbd01df1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:42.498866 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b1d92ce5-bc39-48f6-b896-4f6c8a27350b req-8922a5d1-ea36-44bd-9d57-55c3dbd01df1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0523007 Nov 24 11:18:42.553857 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b1d92ce5-bc39-48f6-b896-4f6c8a27350b req-0f1f5942-14a6-46f5-bbc2-1868bfc32422 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490563 Nov 24 11:18:43.137289 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 5e1dd2e6-fe77-43bc-98bf-f1a63705734c no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:18:43.157687 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 5e1dd2e6-fe77-43bc-98bf-f1a63705734c {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:18:43.158023 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 5e1dd2e6-fe77-43bc-98bf-f1a63705734c not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:18:43.673217 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e27827c-21d5-4012-97d4-d77e032a39a3 req-c20525a3-0b06-43ae-80ba-e9f2aa1a716b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:43.674615 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3e27827c-21d5-4012-97d4-d77e032a39a3 req-c20525a3-0b06-43ae-80ba-e9f2aa1a716b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0526483 Nov 24 11:18:43.723051 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3e27827c-21d5-4012-97d4-d77e032a39a3 req-fec5ce08-aaf8-467d-ae31-84c4dbcab5d3 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423949 Nov 24 11:18:43.858039 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31df2478-f8e9-439d-8f9a-dc8d34684b15 req-1d784d1e-d37b-4782-85ec-682f9689c401 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:43.859530 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-31df2478-f8e9-439d-8f9a-dc8d34684b15 req-1d784d1e-d37b-4782-85ec-682f9689c401 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 945 time: 0.0487471 Nov 24 11:18:43.906123 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-31df2478-f8e9-439d-8f9a-dc8d34684b15 req-2f17dc95-f5a3-4831-a880-28819bff645c tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407057 Nov 24 11:18:44.018951 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:44.800847 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:44.841155 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-062fac95-4c24-4edb-98c4-b6cb067690a5 req-9005d209-bd66-4bc3-bca0-e3315692c526 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:44.842750 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-062fac95-4c24-4edb-98c4-b6cb067690a5 req-9005d209-bd66-4bc3-bca0-e3315692c526 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0490220 Nov 24 11:18:44.892968 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-062fac95-4c24-4edb-98c4-b6cb067690a5 req-367213e4-a052-4fe8-9f6a-d1326fcd3870 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443201 Nov 24 11:18:45.020320 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c26308d4-ac65-4d11-8235-c518b8967f1c req-9fa12051-86bd-42c6-a93c-242273980773 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:45.021762 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c26308d4-ac65-4d11-8235-c518b8967f1c req-9fa12051-86bd-42c6-a93c-242273980773 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 945 time: 0.0479333 Nov 24 11:18:45.069438 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c26308d4-ac65-4d11-8235-c518b8967f1c req-4925cd00-71ba-4728-b19e-9d88e7df2644 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/security-groups?id=a63121b3-63c6-430a-b698-5e13ca890eba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415893 Nov 24 11:18:45.614345 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c4a12a2-be76-4445-b569-ee7d62b09386 req-bdf2625b-034d-491a-9c4b-dfdc106a16b7 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:45.615828 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7c4a12a2-be76-4445-b569-ee7d62b09386 req-bdf2625b-034d-491a-9c4b-dfdc106a16b7 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 945 time: 0.0523098 Nov 24 11:18:45.709336 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-7c4a12a2-be76-4445-b569-ee7d62b09386 req-d282ff4b-010a-4763-87cd-c41117f29224 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Deleting port af19a68f-fbb1-4d8c-9034-627d69f6dfd0 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:18:45.709666 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7c4a12a2-be76-4445-b569-ee7d62b09386 req-d282ff4b-010a-4763-87cd-c41117f29224 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:45.801651 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-7c4a12a2-be76-4445-b569-ee7d62b09386 req-d282ff4b-010a-4763-87cd-c41117f29224 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] For port af19a68f-fbb1-4d8c-9034-627d69f6dfd0, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=af19a68f-fbb1-4d8c-9034-627d69f6dfd0,segment=NetworkSegment(66147b3f-41b0-4ec8-96ba-af958618b639),segment_id=66147b3f-41b0-4ec8-96ba-af958618b639)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:18:45.802008 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7c4a12a2-be76-4445-b569-ee7d62b09386 req-d282ff4b-010a-4763-87cd-c41117f29224 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:45.814038 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-7c4a12a2-be76-4445-b569-ee7d62b09386 req-d282ff4b-010a-4763-87cd-c41117f29224 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Calling delete_port for af19a68f-fbb1-4d8c-9034-627d69f6dfd0 owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:18:46.013571 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d4a2219-cf6b-49cc-8c14-a2c784710a0c req-ffa1df02-87a8-4b41-87f5-8836d9daf0f6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:46.015051 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8d4a2219-cf6b-49cc-8c14-a2c784710a0c req-ffa1df02-87a8-4b41-87f5-8836d9daf0f6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0474780 Nov 24 11:18:46.029862 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7c4a12a2-be76-4445-b569-ee7d62b09386 req-d282ff4b-010a-4763-87cd-c41117f29224 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:46.042924 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['af19a68f-fbb1-4d8c-9034-627d69f6dfd0'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:18:46.061076 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d282ff4b-010a-4763-87cd-c41117f29224 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Pushing event deleted for resources: {'Port': ['ID=af19a68f-fbb1-4d8c-9034-627d69f6dfd0,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:46.066962 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8d4a2219-cf6b-49cc-8c14-a2c784710a0c req-94df3a48-37ca-46c4-90ee-316a42c599e0 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456719 Nov 24 11:18:46.105231 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-7c4a12a2-be76-4445-b569-ee7d62b09386 req-d282ff4b-010a-4763-87cd-c41117f29224 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] No DVR routers for this DVR port af19a68f-fbb1-4d8c-9034-627d69f6dfd0 on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:18:46.107858 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7c4a12a2-be76-4445-b569-ee7d62b09386 req-d282ff4b-010a-4763-87cd-c41117f29224 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:46.111225 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7c4a12a2-be76-4445-b569-ee7d62b09386 req-d282ff4b-010a-4763-87cd-c41117f29224 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.86 "DELETE /v2.0/ports/af19a68f-fbb1-4d8c-9034-627d69f6dfd0 HTTP/1.1" status: 204 len: 173 time: 0.4840455 Nov 24 11:18:46.111694 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b4304784-90ed-4c3d-8dfe-c9e1397abf4d', 'name': 'network-vif-deleted', 'tag': 'af19a68f-fbb1-4d8c-9034-627d69f6dfd0'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:18:46.113908 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e631d6b1-d2e4-4b41-bfce-d4bc1f07df90" -d '{"events": [{"server_uuid": "b4304784-90ed-4c3d-8dfe-c9e1397abf4d", "name": "network-vif-deleted", "tag": "af19a68f-fbb1-4d8c-9034-627d69f6dfd0"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:18:46.149340 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:18:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ee9e92ad-97d2-41be-9a10-9151b5643c28 x-openstack-request-id: req-ee9e92ad-97d2-41be-9a10-9151b5643c28 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:18:46.149633 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b4304784-90ed-4c3d-8dfe-c9e1397abf4d", "name": "network-vif-deleted", "tag": "af19a68f-fbb1-4d8c-9034-627d69f6dfd0", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:18:46.149881 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-ee9e92ad-97d2-41be-9a10-9151b5643c28 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:18:46.150263 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b4304784-90ed-4c3d-8dfe-c9e1397abf4d', 'name': 'network-vif-deleted', 'tag': 'af19a68f-fbb1-4d8c-9034-627d69f6dfd0', 'status': 'completed', 'code': 200} Nov 24 11:18:46.171631 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0bd405a8-c053-468f-89ed-cf73bf3013b4 req-2d612823-c39d-46c5-bea1-8beae536e7e5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 210 time: 0.0307970 Nov 24 11:18:46.490229 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b7b7355-8832-4203-b805-4621049fb676 req-1b4e52fe-6c7b-4665-a749-f5a5f8451748 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:46.491618 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-2b7b7355-8832-4203-b805-4621049fb676 req-1b4e52fe-6c7b-4665-a749-f5a5f8451748 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 1099 time: 0.0391874 Nov 24 11:18:46.537757 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-2b7b7355-8832-4203-b805-4621049fb676 req-b19b3ea4-0522-49c9-9472-4f32672ca697 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0367844 Nov 24 11:18:47.185907 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-310d2352-1e8e-439f-9257-b350210e501a req-b12703fb-e67a-4380-bbb4-ce881b5e0967 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:47.187413 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-310d2352-1e8e-439f-9257-b350210e501a req-b12703fb-e67a-4380-bbb4-ce881b5e0967 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0493524 Nov 24 11:18:47.242530 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-310d2352-1e8e-439f-9257-b350210e501a req-9fdcfd18-8b1e-44d0-bb0f-27ae12481376 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489254 Nov 24 11:18:47.280199 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-48b85c11-0571-4278-a679-ad16d4fc7659 req-7f0349e0-819b-4717-973f-21366aa835a5 tempest-AttachVolumeNegativeTest-154501473 tempest-AttachVolumeNegativeTest-154501473-project] 10.222.0.76 "GET /v2.0/ports?device_id=b4304784-90ed-4c3d-8dfe-c9e1397abf4d HTTP/1.1" status: 200 len: 210 time: 0.0267844 Nov 24 11:18:48.335860 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58096) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:48.357864 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3e905ce-dad5-4046-a381-490a654b7458 req-fa2657d2-6469-4700-8931-e64df3570b2d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:48.359345 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b3e905ce-dad5-4046-a381-490a654b7458 req-fa2657d2-6469-4700-8931-e64df3570b2d tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0497150 Nov 24 11:18:48.383512 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_v2 [None req-f0b8eb94-216e-43bd-9f0e-c32dcd34a306 admin admin] Deleting subnet cd868cb4-b7fb-4350-b027-a21baabac768 {{(pid=103243) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:18:48.386581 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f0b8eb94-216e-43bd-9f0e-c32dcd34a306 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:48.414834 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b3e905ce-dad5-4046-a381-490a654b7458 req-3dc03787-3b56-4520-b3a4-fe9152470cd7 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495753 Nov 24 11:18:48.423414 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f0b8eb94-216e-43bd-9f0e-c32dcd34a306 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:48.429143 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f0b8eb94-216e-43bd-9f0e-c32dcd34a306 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:48.550934 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f0b8eb94-216e-43bd-9f0e-c32dcd34a306 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for subnet, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:48.576721 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b8eb94-216e-43bd-9f0e-c32dcd34a306 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=cd868cb4-b7fb-4350-b027-a21baabac768,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:48.582501 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f0b8eb94-216e-43bd-9f0e-c32dcd34a306 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:48.585819 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-f0b8eb94-216e-43bd-9f0e-c32dcd34a306 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/cd868cb4-b7fb-4350-b027-a21baabac768 HTTP/1.1" status: 204 len: 168 time: 0.2489803 Nov 24 11:18:48.588265 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58104) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:48.659312 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:48.740746 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:48.766255 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.766611 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.767437 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.767722 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > port after_create 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.772109 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > port after_delete 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.772109 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > port after_update 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.772109 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.772109 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.772109 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.772109 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.813578 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f18c259d-4d64-42c5-b3d7-8543e524b835 req-e12756a1-97e3-45d4-bd7b-e75e9ab0c704 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:48.815057 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f18c259d-4d64-42c5-b3d7-8543e524b835 req-e12756a1-97e3-45d4-bd7b-e75e9ab0c704 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0505481 Nov 24 11:18:48.864151 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f18c259d-4d64-42c5-b3d7-8543e524b835 req-2d4c2cf0-bada-4102-9556-ac85ba84e2e6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427904 Nov 24 11:18:48.898203 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.898545 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.898875 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.899199 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=103243) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 24 11:18:48.899582 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8558262b-7125-4688-a6ea-2f1d2c3b2876']}} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:18:48.927235 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '66147b3f-41b0-4ec8-96ba-af958618b639') {'for_net_delete': True} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:18:48.927526 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '66147b3f-41b0-4ec8-96ba-af958618b639') {} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:18:48.957033 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-9292944'] for segment, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:48.981020 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:48.992115 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Releasing vlan 1227 on physical network physnet1 to pool {{(pid=103243) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:18:48.992490 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8721920'] for segment, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: from cryptography.utils import int_from_bytes Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: from cryptography.utils import int_from_bytes Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: Traceback (most recent call last): Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: timer() Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: cb(*args, **kw) Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: return func(*args, **kwargs) Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: self._notify() Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: self.callback(batched_events) Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: event.method(event) Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: return f(self, *a, **k) Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._get(url).json() Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: return self.request(url, 'GET', **kwargs) Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:18:48.996285 dv-cinder-804035-18-iscsi neutron-server[103243]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:18:49.007416 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96dcaf83-e6a4-4591-a6f9-300ff0efc52b req-c346c9f1-b7ac-43db-929d-f339fddb0c82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:49.008969 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-96dcaf83-e6a4-4591-a6f9-300ff0efc52b req-c346c9f1-b7ac-43db-929d-f339fddb0c82 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=30efcb46099b42a3a76be0d52d0d0213&device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 1099 time: 0.1033978 Nov 24 11:18:49.130428 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96dcaf83-e6a4-4591-a6f9-300ff0efc52b req-e3c91a97-305d-4e60-8077-3169fabcdb8d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:49.131964 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-96dcaf83-e6a4-4591-a6f9-300ff0efc52b req-e3c91a97-305d-4e60-8077-3169fabcdb8d service neutron] 10.222.0.86 "GET /v2.0/networks?id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a HTTP/1.1" status: 200 len: 921 time: 0.1147976 Nov 24 11:18:49.179137 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-96dcaf83-e6a4-4591-a6f9-300ff0efc52b req-afcac242-2549-4be1-b4c4-4bae05d781be service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=bc9cf739-16b6-4224-a3fd-869dd9adb0f4 HTTP/1.1" status: 200 len: 217 time: 0.0366430 Nov 24 11:18:49.180658 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:49.182278 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device af19a68f-fbb1-4d8c-9034-627d69f6dfd0 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:18:49.202379 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: af19a68f-fbb1-4d8c-9034-627d69f6dfd0 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:18:49.202718 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device af19a68f-fbb1-4d8c-9034-627d69f6dfd0 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:18:49.203962 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:49.207552 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] 10.222.0.76 "DELETE /v2.0/networks/8558262b-7125-4688-a6ea-2f1d2c3b2876 HTTP/1.1" status: 204 len: 168 time: 0.6182523 Nov 24 11:18:49.209926 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e3b2516-6d3f-4617-b621-7b41f21b9875 admin admin] Pushing event deleted for resources: {'Network': ['ID=8558262b-7125-4688-a6ea-2f1d2c3b2876,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:49.245689 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96dcaf83-e6a4-4591-a6f9-300ff0efc52b req-9764b26a-4318-4f23-8081-60636511c31f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:49.247136 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-96dcaf83-e6a4-4591-a6f9-300ff0efc52b req-9764b26a-4318-4f23-8081-60636511c31f service neutron] 10.222.0.86 "GET /v2.0/subnets?id=e89fe7df-9fbd-43c3-9f7a-0597324b938f HTTP/1.1" status: 200 len: 859 time: 0.0587220 Nov 24 11:18:49.281412 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-96dcaf83-e6a4-4591-a6f9-300ff0efc52b req-c6aff469-0b84-4756-b3e8-454084676c72 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=b21f02d2-c533-4fb1-acd2-d2fd73a5180a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0257630 Nov 24 11:18:49.374604 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-96dcaf83-e6a4-4591-a6f9-300ff0efc52b req-6088271d-8741-4efe-971b-3528d0485aa4 service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863001 Nov 24 11:18:49.468135 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-96dcaf83-e6a4-4591-a6f9-300ff0efc52b req-921a47c8-9121-407b-afb1-7c65795904ad service neutron] 10.222.0.86 "GET /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853131 Nov 24 11:18:49.565862 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58110) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:49.606110 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-9297646f-eacd-4edc-b82c-4cf7acacef6c admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=fae8312f669b48b797904792401edfa4&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0390801 Nov 24 11:18:49.608652 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58112) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:49.659497 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3e5a6e5c-1de4-4ecc-8e16-2f4f67082d57 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:49.680177 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3e5a6e5c-1de4-4ecc-8e16-2f4f67082d57 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:49.830776 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3e5a6e5c-1de4-4ecc-8e16-2f4f67082d57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:49.833351 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3e5a6e5c-1de4-4ecc-8e16-2f4f67082d57 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:49.834510 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-3e5a6e5c-1de4-4ecc-8e16-2f4f67082d57 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/a63121b3-63c6-430a-b698-5e13ca890eba HTTP/1.1" status: 204 len: 168 time: 0.2249868 Nov 24 11:18:49.842423 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e5a6e5c-1de4-4ecc-8e16-2f4f67082d57 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a63121b3-63c6-430a-b698-5e13ca890eba,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:49.982404 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51acb6b-e88e-41a8-90e3-588d00f65be5 req-12b7ae8e-090e-40f7-a8c1-303bcb2459a1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:49.983922 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a51acb6b-e88e-41a8-90e3-588d00f65be5 req-12b7ae8e-090e-40f7-a8c1-303bcb2459a1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0501282 Nov 24 11:18:50.031220 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a51acb6b-e88e-41a8-90e3-588d00f65be5 req-4884b629-edb5-4bb1-8a57-d500c35bad2a tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414011 Nov 24 11:18:51.151272 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f432f42-ec20-4ae0-9435-a64c2871d14d req-25076012-dfeb-4511-95bd-c894c0d305ab tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:51.152669 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2f432f42-ec20-4ae0-9435-a64c2871d14d req-25076012-dfeb-4511-95bd-c894c0d305ab tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0519590 Nov 24 11:18:51.198963 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2f432f42-ec20-4ae0-9435-a64c2871d14d req-1589df85-b90d-477d-ad95-23b16ed7ee96 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400302 Nov 24 11:18:52.312968 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aff18f2c-6f97-4169-ae3a-d70b5e51d4a6 req-4d83e6d5-04f0-49a4-af76-a6f9ea879c30 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:52.314418 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-aff18f2c-6f97-4169-ae3a-d70b5e51d4a6 req-4d83e6d5-04f0-49a4-af76-a6f9ea879c30 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0478556 Nov 24 11:18:52.364727 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-aff18f2c-6f97-4169-ae3a-d70b5e51d4a6 req-aa31aad6-37b7-4b39-a0da-521903f7d3d4 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441928 Nov 24 11:18:52.806398 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58192) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:52.915563 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-40878b10-2c89-40f4-b673-893253797f74 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:52.994249 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-40878b10-2c89-40f4-b673-893253797f74 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:53.065272 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-40878b10-2c89-40f4-b673-893253797f74 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:53.104693 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-40878b10-2c89-40f4-b673-893253797f74 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=cab24ce041e9438fa2fc7c5715417a16&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2966106 Nov 24 11:18:53.106157 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40878b10-2c89-40f4-b673-893253797f74 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e52756e4-d076-41b1-adab-e04fc5f02a02,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:53.108004 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58196) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:53.155918 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8b6e7837-2125-42f7-b68a-89c959adcd6c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:53.176356 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8b6e7837-2125-42f7-b68a-89c959adcd6c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:53.345689 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8b6e7837-2125-42f7-b68a-89c959adcd6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:53.349222 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8b6e7837-2125-42f7-b68a-89c959adcd6c admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:53.350395 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-8b6e7837-2125-42f7-b68a-89c959adcd6c admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/e52756e4-d076-41b1-adab-e04fc5f02a02 HTTP/1.1" status: 204 len: 168 time: 0.2412441 Nov 24 11:18:53.360524 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b6e7837-2125-42f7-b68a-89c959adcd6c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e52756e4-d076-41b1-adab-e04fc5f02a02,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:54.012237 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58206) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:54.026461 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-42218381-10b0-4258-a74c-ef1f74624b44 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:54.099925 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-42218381-10b0-4258-a74c-ef1f74624b44 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:54.162124 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-42218381-10b0-4258-a74c-ef1f74624b44 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:54.201082 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-42218381-10b0-4258-a74c-ef1f74624b44 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=305b0030bd5b45f99d2d0e5244c4097e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1878061 Nov 24 11:18:54.202403 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42218381-10b0-4258-a74c-ef1f74624b44 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c208bef4-0863-4b9e-9f6d-346a77297101,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:54.204291 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58208) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:18:54.254415 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-98e6f614-f780-4697-ba8b-5f913d5f78f2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:54.275124 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-98e6f614-f780-4697-ba8b-5f913d5f78f2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:54.373281 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-98e6f614-f780-4697-ba8b-5f913d5f78f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:54.375919 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-98e6f614-f780-4697-ba8b-5f913d5f78f2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:18:54.377054 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-98e6f614-f780-4697-ba8b-5f913d5f78f2 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/c208bef4-0863-4b9e-9f6d-346a77297101 HTTP/1.1" status: 204 len: 168 time: 0.1706340 Nov 24 11:18:54.385496 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98e6f614-f780-4697-ba8b-5f913d5f78f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c208bef4-0863-4b9e-9f6d-346a77297101,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:18:57.832393 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6efbfc16-6f0c-492c-bd8a-4eb7edd0ac38 req-f237c883-2875-49d8-82ad-3c0cd59623f3 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:57.838609 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6efbfc16-6f0c-492c-bd8a-4eb7edd0ac38 req-f237c883-2875-49d8-82ad-3c0cd59623f3 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0494666 Nov 24 11:18:57.880102 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6efbfc16-6f0c-492c-bd8a-4eb7edd0ac38 req-c12b6c63-f8e1-4644-b333-5e5f11d28748 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401249 Nov 24 11:18:59.005190 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f12b81d0-55d5-4b20-b146-9d0167479e2d req-83fad779-ce95-4bf6-a092-8ee13f624ecc tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:18:59.006675 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f12b81d0-55d5-4b20-b146-9d0167479e2d req-83fad779-ce95-4bf6-a092-8ee13f624ecc tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0563018 Nov 24 11:18:59.054052 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f12b81d0-55d5-4b20-b146-9d0167479e2d req-fb11e911-61c1-4ed9-bb03-f1a8b8a8cbbe tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406663 Nov 24 11:19:00.167815 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e516ee4-69a3-4d4f-a254-dc4279edcb57 req-066735c7-745b-46d2-aabd-e431c1fd5245 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:00.169263 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5e516ee4-69a3-4d4f-a254-dc4279edcb57 req-066735c7-745b-46d2-aabd-e431c1fd5245 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0480399 Nov 24 11:19:00.216055 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5e516ee4-69a3-4d4f-a254-dc4279edcb57 req-f8dce252-b820-41cc-91c4-e0eb320c1ebe tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407789 Nov 24 11:19:00.627397 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef7db542-7409-4c3b-ae0d-584605e05159 req-919a4710-6f7e-4876-8a30-38f2937a1768 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:00.628849 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ef7db542-7409-4c3b-ae0d-584605e05159 req-919a4710-6f7e-4876-8a30-38f2937a1768 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.86 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 946 time: 0.0502954 Nov 24 11:19:00.719084 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-ef7db542-7409-4c3b-ae0d-584605e05159 req-e21543bc-985e-4895-85f9-853f51728bd6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Deleting port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:19:00.719856 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ef7db542-7409-4c3b-ae0d-584605e05159 req-e21543bc-985e-4895-85f9-853f51728bd6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:00.808841 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-ef7db542-7409-4c3b-ae0d-584605e05159 req-e21543bc-985e-4895-85f9-853f51728bd6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] For port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=6cf63bf9-c3aa-422b-a4f0-c496f8b73423,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:00.809196 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ef7db542-7409-4c3b-ae0d-584605e05159 req-e21543bc-985e-4895-85f9-853f51728bd6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:00.821799 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-ef7db542-7409-4c3b-ae0d-584605e05159 req-e21543bc-985e-4895-85f9-853f51728bd6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Calling delete_port for 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:19:01.012187 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ef7db542-7409-4c3b-ae0d-584605e05159 req-e21543bc-985e-4895-85f9-853f51728bd6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:01.023847 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['bc9cf739-16b6-4224-a3fd-869dd9adb0f4', '6cf63bf9-c3aa-422b-a4f0-c496f8b73423'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:19:01.039518 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e21543bc-985e-4895-85f9-853f51728bd6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Pushing event deleted for resources: {'Port': ['ID=6cf63bf9-c3aa-422b-a4f0-c496f8b73423,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:01.084686 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-ef7db542-7409-4c3b-ae0d-584605e05159 req-e21543bc-985e-4895-85f9-853f51728bd6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] No DVR routers for this DVR port 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:19:01.087670 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ef7db542-7409-4c3b-ae0d-584605e05159 req-e21543bc-985e-4895-85f9-853f51728bd6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:01.091238 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ef7db542-7409-4c3b-ae0d-584605e05159 req-e21543bc-985e-4895-85f9-853f51728bd6 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.86 "DELETE /v2.0/ports/6cf63bf9-c3aa-422b-a4f0-c496f8b73423 HTTP/1.1" status: 204 len: 173 time: 0.4553785 Nov 24 11:19:01.091758 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9395c84b-5176-4a1b-a13c-dc62c8222c1a', 'name': 'network-vif-deleted', 'tag': '6cf63bf9-c3aa-422b-a4f0-c496f8b73423'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:19:01.094112 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02cce86f-c8a3-45c9-b989-ba70c87ffe5a" -d '{"events": [{"server_uuid": "9395c84b-5176-4a1b-a13c-dc62c8222c1a", "name": "network-vif-deleted", "tag": "6cf63bf9-c3aa-422b-a4f0-c496f8b73423"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:19:01.138810 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:19:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3df396e3-8163-41f4-8806-3888f324c727 x-openstack-request-id: req-3df396e3-8163-41f4-8806-3888f324c727 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:19:01.139219 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9395c84b-5176-4a1b-a13c-dc62c8222c1a", "name": "network-vif-deleted", "tag": "6cf63bf9-c3aa-422b-a4f0-c496f8b73423", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:19:01.139586 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-3df396e3-8163-41f4-8806-3888f324c727 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:19:01.140234 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9395c84b-5176-4a1b-a13c-dc62c8222c1a', 'name': 'network-vif-deleted', 'tag': '6cf63bf9-c3aa-422b-a4f0-c496f8b73423', 'status': 'completed', 'code': 200} Nov 24 11:19:01.315468 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7d92974f-0a65-488d-87e8-3da96672a4d7 req-f3e691b5-b11c-4975-94a0-800245db30d1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=9395c84b-5176-4a1b-a13c-dc62c8222c1a HTTP/1.1" status: 200 len: 210 time: 0.0299020 Nov 24 11:19:01.569148 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58314) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:01.669856 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-45872aa4-bd74-4b20-aa19-d13a46022665 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:01.742033 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-45872aa4-bd74-4b20-aa19-d13a46022665 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:01.812768 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-45872aa4-bd74-4b20-aa19-d13a46022665 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:01.853448 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-45872aa4-bd74-4b20-aa19-d13a46022665 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=b3d8425674f24c06814946b8c12b8f57&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2832718 Nov 24 11:19:01.854304 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45872aa4-bd74-4b20-aa19-d13a46022665 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=03a4fdbb-1f9b-47dd-b4a5-9b132b485204,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:01.856157 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58318) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:01.904748 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1c3c717c-2cb2-4aa1-b2d7-c6ee07d1e48b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:01.926380 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1c3c717c-2cb2-4aa1-b2d7-c6ee07d1e48b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:02.047841 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1c3c717c-2cb2-4aa1-b2d7-c6ee07d1e48b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:02.050442 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1c3c717c-2cb2-4aa1-b2d7-c6ee07d1e48b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:02.051846 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-1c3c717c-2cb2-4aa1-b2d7-c6ee07d1e48b admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/03a4fdbb-1f9b-47dd-b4a5-9b132b485204 HTTP/1.1" status: 204 len: 168 time: 0.1944196 Nov 24 11:19:02.063575 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c3c717c-2cb2-4aa1-b2d7-c6ee07d1e48b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=03a4fdbb-1f9b-47dd-b4a5-9b132b485204,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:02.668952 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58328) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:02.682183 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1f506f36-f572-4b6d-a71f-586c8a4172bf admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:02.782882 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1f506f36-f572-4b6d-a71f-586c8a4172bf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:02.802330 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33cc5d27-bf38-4dd9-9fe7-a9642623082d req-29046093-7753-45e8-aa83-1a3105b1f261 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:02.803810 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-33cc5d27-bf38-4dd9-9fe7-a9642623082d req-29046093-7753-45e8-aa83-1a3105b1f261 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0638044 Nov 24 11:19:02.847240 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1f506f36-f572-4b6d-a71f-586c8a4172bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:02.866991 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-33cc5d27-bf38-4dd9-9fe7-a9642623082d req-fc9869af-d025-46f4-a28e-eba2b1b2288c tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571194 Nov 24 11:19:02.890954 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f506f36-f572-4b6d-a71f-586c8a4172bf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a1fdac96-3517-439d-ad63-ac1e0cbcee40,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:02.895423 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-1f506f36-f572-4b6d-a71f-586c8a4172bf admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=5a51859d12e54221bfb033b1a05f7faf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2254386 Nov 24 11:19:02.898350 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58332) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:02.944698 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-552d2ec0-d3b7-4eaa-84e9-c12a7237e81b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:02.965824 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-552d2ec0-d3b7-4eaa-84e9-c12a7237e81b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:03.093466 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-552d2ec0-d3b7-4eaa-84e9-c12a7237e81b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:03.096086 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-552d2ec0-d3b7-4eaa-84e9-c12a7237e81b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:03.097331 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-552d2ec0-d3b7-4eaa-84e9-c12a7237e81b admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/a1fdac96-3517-439d-ad63-ac1e0cbcee40 HTTP/1.1" status: 204 len: 168 time: 0.1980429 Nov 24 11:19:03.105010 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-552d2ec0-d3b7-4eaa-84e9-c12a7237e81b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1fdac96-3517-439d-ad63-ac1e0cbcee40,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:03.260384 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:19:03.280886 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:19:03.281243 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 6cf63bf9-c3aa-422b-a4f0-c496f8b73423 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:19:03.983816 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9713f5ea-368b-42bc-95e3-09a1c16da711 req-02dc6764-fe44-445b-8b9e-222aa173946a tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:03.985297 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9713f5ea-368b-42bc-95e3-09a1c16da711 req-02dc6764-fe44-445b-8b9e-222aa173946a tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0490057 Nov 24 11:19:04.040057 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9713f5ea-368b-42bc-95e3-09a1c16da711 req-00255605-53fc-4808-b7c8-bc2cd69c1e0f tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487554 Nov 24 11:19:05.155712 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38c88939-31a1-487c-86c1-a26681ef71d9 req-74f449d3-9dac-4289-816c-9af11f60fcf9 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:05.158134 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-38c88939-31a1-487c-86c1-a26681ef71d9 req-74f449d3-9dac-4289-816c-9af11f60fcf9 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0499809 Nov 24 11:19:05.208766 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-38c88939-31a1-487c-86c1-a26681ef71d9 req-f919c182-7dc7-4b81-9ecb-2890cbb48a69 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444083 Nov 24 11:19:06.323348 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4668eddf-228f-4754-9882-52eb8e8d8262 req-3b4da3b1-378c-432f-98ef-77eea02278d1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:06.324819 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4668eddf-228f-4754-9882-52eb8e8d8262 req-3b4da3b1-378c-432f-98ef-77eea02278d1 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0482395 Nov 24 11:19:06.372320 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4668eddf-228f-4754-9882-52eb8e8d8262 req-54012ec7-7c3a-449c-a816-84c701a39a00 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408111 Nov 24 11:19:07.499254 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a615032e-132d-4985-86ba-3bdac7c3de8e req-c7c26d2c-4c94-426f-92d8-673221aaf266 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:07.501859 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a615032e-132d-4985-86ba-3bdac7c3de8e req-c7c26d2c-4c94-426f-92d8-673221aaf266 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0576885 Nov 24 11:19:07.549986 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a615032e-132d-4985-86ba-3bdac7c3de8e req-a12de230-176d-4639-9d7c-265bfa4f9cbe tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420730 Nov 24 11:19:08.669770 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751c76b3-2516-4888-a1f8-f6f14630fef7 req-38cf5658-3a6c-425d-87ad-b84aa2a9597b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:08.671285 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-751c76b3-2516-4888-a1f8-f6f14630fef7 req-38cf5658-3a6c-425d-87ad-b84aa2a9597b tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0540140 Nov 24 11:19:08.721500 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-751c76b3-2516-4888-a1f8-f6f14630fef7 req-83992b4f-d8d9-4eb0-aaf0-259a91976854 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/security-groups?id=f1c244bc-af79-4d84-9201-e93ea1d6e9d3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441573 Nov 24 11:19:08.818971 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-508ee8aa-2075-422e-aed0-2489ad54be3a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:09.114546 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaaddf0f-a747-4d95-a732-1a31efbb2d6d req-ae5dcace-28c7-460d-8704-971c1e03d7d8 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:09.116095 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-eaaddf0f-a747-4d95-a732-1a31efbb2d6d req-ae5dcace-28c7-460d-8704-971c1e03d7d8 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.86 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 946 time: 0.0508814 Nov 24 11:19:09.179374 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:09.210303 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-eaaddf0f-a747-4d95-a732-1a31efbb2d6d req-164bf2f7-1594-4a95-b175-9ab53c2076ee tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Deleting port bc9cf739-16b6-4224-a3fd-869dd9adb0f4 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:19:09.210639 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eaaddf0f-a747-4d95-a732-1a31efbb2d6d req-164bf2f7-1594-4a95-b175-9ab53c2076ee tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:09.301710 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-eaaddf0f-a747-4d95-a732-1a31efbb2d6d req-164bf2f7-1594-4a95-b175-9ab53c2076ee tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] For port bc9cf739-16b6-4224-a3fd-869dd9adb0f4, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=bc9cf739-16b6-4224-a3fd-869dd9adb0f4,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:09.302052 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eaaddf0f-a747-4d95-a732-1a31efbb2d6d req-164bf2f7-1594-4a95-b175-9ab53c2076ee tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:09.314800 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-eaaddf0f-a747-4d95-a732-1a31efbb2d6d req-164bf2f7-1594-4a95-b175-9ab53c2076ee tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Calling delete_port for bc9cf739-16b6-4224-a3fd-869dd9adb0f4 owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:19:09.492588 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eaaddf0f-a747-4d95-a732-1a31efbb2d6d req-164bf2f7-1594-4a95-b175-9ab53c2076ee tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:09.505378 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['bc9cf739-16b6-4224-a3fd-869dd9adb0f4'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:19:09.760436 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-164bf2f7-1594-4a95-b175-9ab53c2076ee tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Pushing event deleted for resources: {'Port': ['ID=bc9cf739-16b6-4224-a3fd-869dd9adb0f4,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:09.805158 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-eaaddf0f-a747-4d95-a732-1a31efbb2d6d req-164bf2f7-1594-4a95-b175-9ab53c2076ee tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] No DVR routers for this DVR port bc9cf739-16b6-4224-a3fd-869dd9adb0f4 on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:19:09.807824 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eaaddf0f-a747-4d95-a732-1a31efbb2d6d req-164bf2f7-1594-4a95-b175-9ab53c2076ee tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:09.811537 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-eaaddf0f-a747-4d95-a732-1a31efbb2d6d req-164bf2f7-1594-4a95-b175-9ab53c2076ee tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.86 "DELETE /v2.0/ports/bc9cf739-16b6-4224-a3fd-869dd9adb0f4 HTTP/1.1" status: 204 len: 173 time: 0.6876552 Nov 24 11:19:09.812108 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a160f50-082e-4f8c-8483-fe7d8b41501e', 'name': 'network-vif-deleted', 'tag': 'bc9cf739-16b6-4224-a3fd-869dd9adb0f4'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:19:09.814384 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01958379-236a-49f8-ac01-f230bb5a5c39" -d '{"events": [{"server_uuid": "1a160f50-082e-4f8c-8483-fe7d8b41501e", "name": "network-vif-deleted", "tag": "bc9cf739-16b6-4224-a3fd-869dd9adb0f4"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:19:09.821968 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff4296e2-fd89-4735-9580-92acb990d500 req-8e631850-dd0f-4094-b514-d38b1856f094 tempest-ServerRescueNegativeTestJSON-935503676 tempest-ServerRescueNegativeTestJSON-935503676-project] 10.222.0.76 "GET /v2.0/ports?device_id=1a160f50-082e-4f8c-8483-fe7d8b41501e HTTP/1.1" status: 200 len: 210 time: 0.0307894 Nov 24 11:19:09.851884 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:19:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-79435b22-6b9c-4000-875e-cec2dfc0237c x-openstack-request-id: req-79435b22-6b9c-4000-875e-cec2dfc0237c {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:19:09.858090 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a160f50-082e-4f8c-8483-fe7d8b41501e", "name": "network-vif-deleted", "tag": "bc9cf739-16b6-4224-a3fd-869dd9adb0f4", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:19:09.858090 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-79435b22-6b9c-4000-875e-cec2dfc0237c {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:19:09.858090 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a160f50-082e-4f8c-8483-fe7d8b41501e', 'name': 'network-vif-deleted', 'tag': 'bc9cf739-16b6-4224-a3fd-869dd9adb0f4', 'status': 'completed', 'code': 200} Nov 24 11:19:10.885231 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58440) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:11.174091 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-23a5abb5-f43e-46d6-ae9f-5e3f9ad836fe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:11.289575 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f7e53bc6-9203-4e47-9566-62e41a73ab51 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1009613'] for router_interface, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:11.569316 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-f7e53bc6-9203-4e47-9566-62e41a73ab51 admin admin] Deleting port 3bd5a5b3-3819-40e6-8486-0b27d5b77365 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:19:11.569558 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f7e53bc6-9203-4e47-9566-62e41a73ab51 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:11.648706 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-f7e53bc6-9203-4e47-9566-62e41a73ab51 admin admin] For port 3bd5a5b3-3819-40e6-8486-0b27d5b77365, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=3bd5a5b3-3819-40e6-8486-0b27d5b77365,segment=NetworkSegment(a796222b-4203-47ee-8ece-5d33e9d64672),segment_id=a796222b-4203-47ee-8ece-5d33e9d64672)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:11.649076 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f7e53bc6-9203-4e47-9566-62e41a73ab51 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:11.661313 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-f7e53bc6-9203-4e47-9566-62e41a73ab51 admin admin] Calling delete_port for 3bd5a5b3-3819-40e6-8486-0b27d5b77365 owned by network:router_interface {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:19:11.870448 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f7e53bc6-9203-4e47-9566-62e41a73ab51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:11.895781 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7e53bc6-9203-4e47-9566-62e41a73ab51 admin admin] Pushing event deleted for resources: {'Port': ['ID=3bd5a5b3-3819-40e6-8486-0b27d5b77365,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:12.304932 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f7e53bc6-9203-4e47-9566-62e41a73ab51 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-637217', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1011037'] for router_interface, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:12.493847 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:12.518733 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7e53bc6-9203-4e47-9566-62e41a73ab51 admin admin] Router 3521649d-4274-4082-9043-224fe9728321 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:19:12.624796 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7e53bc6-9203-4e47-9566-62e41a73ab51 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:19:12.629977 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-f7e53bc6-9203-4e47-9566-62e41a73ab51 admin admin] 10.222.0.76 "PUT /v2.0/routers/3521649d-4274-4082-9043-224fe9728321/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7471597 Nov 24 11:19:12.632411 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58464) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:12.635003 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a7adec8-e667-45e7-9e35-46f4cadb3a07 None None] Sync routers for ids ['3521649d-4274-4082-9043-224fe9728321'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:19:12.648053 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a7adec8-e667-45e7-9e35-46f4cadb3a07 None None] Routers {'3521649d-4274-4082-9043-224fe9728321'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:12.648970 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-1a7adec8-e667-45e7-9e35-46f4cadb3a07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['3521649d-4274-4082-9043-224fe9728321'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:12.744713 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Publish callbacks [] for router, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:12.845231 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-1a7adec8-e667-45e7-9e35-46f4cadb3a07 None None] Set router 3521649d-4274-4082-9043-224fe9728321 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:12.856080 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:13.021490 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Deleting port 15b4d7f1-cd06-48e1-b481-3633461f0922 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:19:13.022163 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:13.038012 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-1a7adec8-e667-45e7-9e35-46f4cadb3a07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3521649d-4274-4082-9043-224fe9728321', 'name': 'tempest-ServerRescueNegativeTestJSON-1610280202-router', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157'}], 'enable_snat': True}, 'gw_port_id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:16:13Z', 'updated_at': '2021-11-24T11:19:11Z', 'revision_number': 5, 'project_id': '30efcb46099b42a3a76be0d52d0d0213', 'gw_port': {'id': '15b4d7f1-cd06-48e1-b481-3633461f0922', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:d0:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3521649d-4274-4082-9043-224fe9728321', 'device_owner': 'network:router_gateway', 'standard_attr_id': 275, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.157', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:16:14Z', 'updated_at': '2021-11-24T11:16:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:13.065289 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a7adec8-e667-45e7-9e35-46f4cadb3a07 None None] Checking router: 3521649d-4274-4082-9043-224fe9728321 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:19:13.074292 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a7adec8-e667-45e7-9e35-46f4cadb3a07 None None] Routers {'3521649d-4274-4082-9043-224fe9728321'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:13.074917 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-1a7adec8-e667-45e7-9e35-46f4cadb3a07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['3521649d-4274-4082-9043-224fe9728321'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:13.115429 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] For port 15b4d7f1-cd06-48e1-b481-3633461f0922, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=15b4d7f1-cd06-48e1-b481-3633461f0922,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:13.116130 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:13.130641 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Calling delete_port for 15b4d7f1-cd06-48e1-b481-3633461f0922 owned by network:router_gateway {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:19:13.166737 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-1a7adec8-e667-45e7-9e35-46f4cadb3a07 None None] Set router 3521649d-4274-4082-9043-224fe9728321 gateway port host: None {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:13.223140 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-1a7adec8-e667-45e7-9e35-46f4cadb3a07 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3521649d-4274-4082-9043-224fe9728321', 'name': 'tempest-ServerRescueNegativeTestJSON-1610280202-router', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:16:13Z', 'updated_at': '2021-11-24T11:19:12Z', 'revision_number': 6, 'project_id': '30efcb46099b42a3a76be0d52d0d0213', 'gw_port_host': None}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:13.249854 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a7adec8-e667-45e7-9e35-46f4cadb3a07 None None] The sync data for ids ['3521649d-4274-4082-9043-224fe9728321'] in dv-cinder-804035-18-iscsi is: [{'id': '3521649d-4274-4082-9043-224fe9728321', 'name': 'tempest-ServerRescueNegativeTestJSON-1610280202-router', 'tenant_id': '30efcb46099b42a3a76be0d52d0d0213', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:16:13Z', 'updated_at': '2021-11-24T11:19:12Z', 'revision_number': 6, 'project_id': '30efcb46099b42a3a76be0d52d0d0213', 'gw_port_host': None}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:19:13.293907 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device bc9cf739-16b6-4224-a3fd-869dd9adb0f4 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:19:13.314589 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: bc9cf739-16b6-4224-a3fd-869dd9adb0f4 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:19:13.314909 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device bc9cf739-16b6-4224-a3fd-869dd9adb0f4 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:19:13.418388 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:13.444039 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Pushing event deleted for resources: {'Port': ['ID=15b4d7f1-cd06-48e1-b481-3633461f0922,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:13.507458 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-942710'] for router_gateway, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:13.620781 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1010955', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-663'] for router, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:13.623131 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:13.768518 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1010962'] for router, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:13.769133 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3521649d-4274-4082-9043-224fe9728321 {{(pid=103244) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 11:19:13.774574 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] Publish callbacks [] for router, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:13.778893 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58492) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:13.788492 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-d8e8a43f-6c40-4c69-8265-92d9ddb59657 admin admin] 10.222.0.76 "DELETE /v2.0/routers/3521649d-4274-4082-9043-224fe9728321 HTTP/1.1" status: 204 len: 168 time: 1.1550708 Nov 24 11:19:13.824717 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_v2 [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Deleting subnet e89fe7df-9fbd-43c3-9f7a-0597324b938f {{(pid=103243) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:19:13.828148 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:13.866288 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-9292937'] for subnet, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:13.905446 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.058334 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8721838', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9106635'] for subnet, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.071546 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-559bdf90-8e57-4958-abbb-e6588e95139e req-c29d1f5d-7728-47f1-b660-ad9cbb5206cb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:14.073023 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-559bdf90-8e57-4958-abbb-e6588e95139e req-c29d1f5d-7728-47f1-b660-ad9cbb5206cb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0508280 Nov 24 11:19:14.087703 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.095277 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e89fe7df-9fbd-43c3-9f7a-0597324b938f,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:14.095277 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.101368 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/e89fe7df-9fbd-43c3-9f7a-0597324b938f HTTP/1.1" status: 204 len: 168 time: 0.3190749 Nov 24 11:19:14.107568 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58496) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:14.115123 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:14.115887 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:14.116325 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:14.116731 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:14.117105 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:14.117447 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:14.117794 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:14.118342 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:14.118932 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:14.119562 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:14.120039 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:14.120559 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-44d61326-e280-484c-aea4-19c5d011cdc4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:14.184974 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de33ab21-4fd3-40ea-86f4-93c3518c5529 req-f7d803f9-166e-4a6b-91d0-1ce3c312c736 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:14.187168 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-de33ab21-4fd3-40ea-86f4-93c3518c5529 req-f7d803f9-166e-4a6b-91d0-1ce3c312c736 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=41b5f46d34ad4033a154a9afabe2091f&device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 1138 time: 0.0493948 Nov 24 11:19:14.196244 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-559bdf90-8e57-4958-abbb-e6588e95139e req-0761cda5-8cba-49f5-9159-7631cc804e5b tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1171174 Nov 24 11:19:14.239259 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.284504 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58500) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:14.316977 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de33ab21-4fd3-40ea-86f4-93c3518c5529 req-c4585abc-323b-4f55-9995-49aa179d6352 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:14.318602 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-de33ab21-4fd3-40ea-86f4-93c3518c5529 req-c4585abc-323b-4f55-9995-49aa179d6352 service neutron] 10.222.0.86 "GET /v2.0/networks?id=c3a531f2-bfe9-4a80-8b71-ad7f35944879 HTTP/1.1" status: 200 len: 917 time: 0.1224444 Nov 24 11:19:14.346596 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.375552 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b21f02d2-c533-4fb1-acd2-d2fd73a5180a']}} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:14.387711 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a796222b-4203-47ee-8ece-5d33e9d64672') {'for_net_delete': True} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:14.388054 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a796222b-4203-47ee-8ece-5d33e9d64672') {} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:14.399922 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4161272'] for segment, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.415586 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.432926 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] Releasing vlan 1226 on physical network physnet1 to pool {{(pid=103244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:19:14.433335 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8699699'] for segment, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: Traceback (most recent call last): Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: timer() Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: cb(*args, **kw) Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: return func(*args, **kwargs) Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: self._notify() Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: self.callback(batched_events) Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: event.method(event) Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: return f(self, *a, **k) Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._get(url).json() Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: return self.request(url, 'GET', **kwargs) Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:19:14.435310 dv-cinder-804035-18-iscsi neutron-server[103244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:19:14.452654 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-de33ab21-4fd3-40ea-86f4-93c3518c5529 req-23e815ba-251e-4bf3-aae4-50566f3f2476 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=57415158-968f-4f63-9c5f-eba02f4dd725 HTTP/1.1" status: 200 len: 1002 time: 0.1244416 Nov 24 11:19:14.466228 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-972c7fa9-3e29-48a6-ae95-723dfeca6dd4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.518173 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de33ab21-4fd3-40ea-86f4-93c3518c5529 req-7289f619-09e5-4876-a4ce-67b19141bb8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:14.519947 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-de33ab21-4fd3-40ea-86f4-93c3518c5529 req-7289f619-09e5-4876-a4ce-67b19141bb8c service neutron] 10.222.0.86 "GET /v2.0/subnets?id=08393eb4-7b60-4211-937a-8e0724891dbc HTTP/1.1" status: 200 len: 854 time: 0.0574915 Nov 24 11:19:14.569062 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de33ab21-4fd3-40ea-86f4-93c3518c5529 req-1fade6e2-6a09-4362-90e0-6de119f80dae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:14.570615 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-de33ab21-4fd3-40ea-86f4-93c3518c5529 req-1fade6e2-6a09-4362-90e0-6de119f80dae service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=c3a531f2-bfe9-4a80-8b71-ad7f35944879&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0413764 Nov 24 11:19:14.576774 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-972c7fa9-3e29-48a6-ae95-723dfeca6dd4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.584768 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.589307 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.596440 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] 10.222.0.76 "DELETE /v2.0/networks/b21f02d2-c533-4fb1-acd2-d2fd73a5180a HTTP/1.1" status: 204 len: 168 time: 0.4842529 Nov 24 11:19:14.606680 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58672de4-81f8-4799-aa76-c1c276790d7b admin admin] Pushing event deleted for resources: {'Network': ['ID=b21f02d2-c533-4fb1-acd2-d2fd73a5180a,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:14.643339 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-972c7fa9-3e29-48a6-ae95-723dfeca6dd4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.672608 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-de33ab21-4fd3-40ea-86f4-93c3518c5529 req-72c643a9-7a05-41f1-8bd1-9f2985206a18 service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0938625 Nov 24 11:19:14.683421 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-972c7fa9-3e29-48a6-ae95-723dfeca6dd4 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=331625cddb104342bf1832b620fbefef&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3977830 Nov 24 11:19:14.684115 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-972c7fa9-3e29-48a6-ae95-723dfeca6dd4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=006be7b2-2949-4fc0-81da-9acea1a76e36,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:14.686586 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58508) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:14.736515 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-72b9e803-f2e7-4c42-8acf-ecc17d38f356 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.758402 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-72b9e803-f2e7-4c42-8acf-ecc17d38f356 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.771961 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-de33ab21-4fd3-40ea-86f4-93c3518c5529 req-a789dcc8-27fd-4564-b348-5d333ba50c5e service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0895538 Nov 24 11:19:14.819446 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.888075 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-72b9e803-f2e7-4c42-8acf-ecc17d38f356 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.890685 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-72b9e803-f2e7-4c42-8acf-ecc17d38f356 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:14.893483 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-72b9e803-f2e7-4c42-8acf-ecc17d38f356 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/006be7b2-2949-4fc0-81da-9acea1a76e36 HTTP/1.1" status: 204 len: 168 time: 0.2050910 Nov 24 11:19:14.893483 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58510) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:14.906391 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72b9e803-f2e7-4c42-8acf-ecc17d38f356 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=006be7b2-2949-4fc0-81da-9acea1a76e36,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:14.942294 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-3acd39fb-e1aa-4a73-abcc-f307a97202ae admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=30efcb46099b42a3a76be0d52d0d0213&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0460646 Nov 24 11:19:14.946569 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58514) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:15.019594 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7bee6207-d3dc-4f67-ac16-78d4605d9ed8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:15.036367 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 15b4d7f1-cd06-48e1-b481-3633461f0922 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:19:15.042857 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7bee6207-d3dc-4f67-ac16-78d4605d9ed8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:15.057612 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 15b4d7f1-cd06-48e1-b481-3633461f0922 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:19:15.058043 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 15b4d7f1-cd06-48e1-b481-3633461f0922 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:19:15.058645 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 3bd5a5b3-3819-40e6-8486-0b27d5b77365 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:19:15.078041 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 3bd5a5b3-3819-40e6-8486-0b27d5b77365 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:19:15.078388 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 3bd5a5b3-3819-40e6-8486-0b27d5b77365 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:19:15.145475 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7bee6207-d3dc-4f67-ac16-78d4605d9ed8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:15.148161 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7bee6207-d3dc-4f67-ac16-78d4605d9ed8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:15.149342 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-7bee6207-d3dc-4f67-ac16-78d4605d9ed8 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/f1c244bc-af79-4d84-9201-e93ea1d6e9d3 HTTP/1.1" status: 204 len: 168 time: 0.2018425 Nov 24 11:19:15.159013 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bee6207-d3dc-4f67-ac16-78d4605d9ed8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1c244bc-af79-4d84-9201-e93ea1d6e9d3,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:15.305883 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e1a003b1-1f63-4801-ad3d-040bcb437f18 req-ac28fa49-12da-46ca-81c3-331f76bec5e3 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0435014 Nov 24 11:19:15.335106 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd8f418c-0c6e-4f8a-9dee-063e5435e237 req-eec8cc57-d06b-47f1-88b3-b021e5658f5e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:15.336436 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dd8f418c-0c6e-4f8a-9dee-063e5435e237 req-eec8cc57-d06b-47f1-88b3-b021e5658f5e tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0515318 Nov 24 11:19:15.376598 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a003b1-1f63-4801-ad3d-040bcb437f18 req-dc402920-552c-4e48-9dc5-250627a2e2d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:15.378093 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e1a003b1-1f63-4801-ad3d-040bcb437f18 req-dc402920-552c-4e48-9dc5-250627a2e2d2 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=907128185ff9473381be53050d202838&device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 1098 time: 0.0468018 Nov 24 11:19:15.402377 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dd8f418c-0c6e-4f8a-9dee-063e5435e237 req-a9f0be57-8b36-4b06-a9b7-49ad24df84bd tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0590394 Nov 24 11:19:15.488389 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a003b1-1f63-4801-ad3d-040bcb437f18 req-29b66760-3661-46ab-a1d7-d7951a27224d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:15.490285 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e1a003b1-1f63-4801-ad3d-040bcb437f18 req-29b66760-3661-46ab-a1d7-d7951a27224d service neutron] 10.222.0.86 "GET /v2.0/networks?id=d9d87ca8-7863-48a6-937c-ee712996776e HTTP/1.1" status: 200 len: 913 time: 0.0928469 Nov 24 11:19:15.566956 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e1a003b1-1f63-4801-ad3d-040bcb437f18 req-f287384d-0e4f-4694-a6b1-dc77a1cb7d8f service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa HTTP/1.1" status: 200 len: 1001 time: 0.0680823 Nov 24 11:19:15.581284 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58532) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:15.595459 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-74878d5a-ffdd-4509-94e2-fb85f62da2cc admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:15.622284 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a003b1-1f63-4801-ad3d-040bcb437f18 req-1ba245ed-3ed7-4b70-b4c6-2e775c4988e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:15.623854 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e1a003b1-1f63-4801-ad3d-040bcb437f18 req-1ba245ed-3ed7-4b70-b4c6-2e775c4988e8 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c0d420cf-0b8e-4f90-a25c-9a74e1eafabb HTTP/1.1" status: 200 len: 850 time: 0.0489407 Nov 24 11:19:15.683265 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a003b1-1f63-4801-ad3d-040bcb437f18 req-93b0657d-fd1e-4b4c-83fa-67d9179550a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:15.688573 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e1a003b1-1f63-4801-ad3d-040bcb437f18 req-93b0657d-fd1e-4b4c-83fa-67d9179550a3 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=d9d87ca8-7863-48a6-937c-ee712996776e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0533712 Nov 24 11:19:15.697789 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-74878d5a-ffdd-4509-94e2-fb85f62da2cc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:15.779552 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-74878d5a-ffdd-4509-94e2-fb85f62da2cc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:15.781332 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e1a003b1-1f63-4801-ad3d-040bcb437f18 req-9c1d7e2d-3de4-4d33-af7c-efd9e5df77c2 service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0875714 Nov 24 11:19:15.822164 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-74878d5a-ffdd-4509-94e2-fb85f62da2cc admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=cdc9ac99d03540f29442533b8a7ff19c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2372053 Nov 24 11:19:15.822164 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74878d5a-ffdd-4509-94e2-fb85f62da2cc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a7bf693-957e-464e-9cbc-8ef0bb2c69c0,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:15.823242 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58538) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:15.907685 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e1a003b1-1f63-4801-ad3d-040bcb437f18 req-f0d58117-8682-4ec7-9bc0-996b8de86be8 service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1149418 Nov 24 11:19:15.917122 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-03f74351-09f0-41b5-8018-2f1719726dda admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:15.946674 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-03f74351-09f0-41b5-8018-2f1719726dda admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:16.065370 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-03f74351-09f0-41b5-8018-2f1719726dda admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:16.068346 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-03f74351-09f0-41b5-8018-2f1719726dda admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:16.074635 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-03f74351-09f0-41b5-8018-2f1719726dda admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/9a7bf693-957e-464e-9cbc-8ef0bb2c69c0 HTTP/1.1" status: 204 len: 168 time: 0.2450383 Nov 24 11:19:16.078019 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03f74351-09f0-41b5-8018-2f1719726dda admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a7bf693-957e-464e-9cbc-8ef0bb2c69c0,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:16.147231 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af89ae2c-9d9c-4d67-99cb-29877b8be594 req-b7ce23a8-ff88-4212-a5f0-48c7be649845 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:16.148749 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-af89ae2c-9d9c-4d67-99cb-29877b8be594 req-b7ce23a8-ff88-4212-a5f0-48c7be649845 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 947 time: 0.0550385 Nov 24 11:19:16.195572 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-af89ae2c-9d9c-4d67-99cb-29877b8be594 req-8bde0752-89dc-455b-8f48-c08beba618e8 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408728 Nov 24 11:19:16.528283 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29298134-0af6-42d0-add1-74994d058713 req-99462f94-97c7-443d-9af8-555563d9e7fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:16.528283 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-29298134-0af6-42d0-add1-74994d058713 req-99462f94-97c7-443d-9af8-555563d9e7fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0496547 Nov 24 11:19:16.588556 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-29298134-0af6-42d0-add1-74994d058713 req-e298475e-2962-4d75-8656-bd503a891e4f tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0589929 Nov 24 11:19:16.731045 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58564) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:16.744535 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3c2b5f04-2058-4bff-b8d2-c38ebe2f3082 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:16.817826 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3c2b5f04-2058-4bff-b8d2-c38ebe2f3082 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:16.921964 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3c2b5f04-2058-4bff-b8d2-c38ebe2f3082 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:16.958837 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c2b5f04-2058-4bff-b8d2-c38ebe2f3082 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=69c9c180-9f16-422e-8037-af9ce481730e,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:16.964216 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-3c2b5f04-2058-4bff-b8d2-c38ebe2f3082 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=4d421aefb05a4352a9d6b5a4044a8b42&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2321315 Nov 24 11:19:16.968206 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58566) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:17.015305 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2cee934b-b2a1-4eab-85ae-1629452b576b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:17.037032 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2cee934b-b2a1-4eab-85ae-1629452b576b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:17.054315 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:19:17.173672 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2cee934b-b2a1-4eab-85ae-1629452b576b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:17.176508 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2cee934b-b2a1-4eab-85ae-1629452b576b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:17.177663 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2cee934b-b2a1-4eab-85ae-1629452b576b admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/69c9c180-9f16-422e-8037-af9ce481730e HTTP/1.1" status: 204 len: 168 time: 0.2085631 Nov 24 11:19:17.188591 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cee934b-b2a1-4eab-85ae-1629452b576b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=69c9c180-9f16-422e-8037-af9ce481730e,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:17.320692 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ead5665-4b79-4049-a9ab-84a69c80b2a7 req-26748927-8b16-4dea-add2-79ec2f3c521f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:17.322261 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ead5665-4b79-4049-a9ab-84a69c80b2a7 req-26748927-8b16-4dea-add2-79ec2f3c521f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 947 time: 0.0537815 Nov 24 11:19:17.369746 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ead5665-4b79-4049-a9ab-84a69c80b2a7 req-2cad8fe6-1058-4596-8548-6691b660b302 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413692 Nov 24 11:19:17.712218 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4883af29-1e81-4b4a-b6c5-7b6dc735e102 req-71bddcff-0cc9-4fc2-a585-07144fd57b24 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:17.713670 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4883af29-1e81-4b4a-b6c5-7b6dc735e102 req-71bddcff-0cc9-4fc2-a585-07144fd57b24 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0502257 Nov 24 11:19:17.776811 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4883af29-1e81-4b4a-b6c5-7b6dc735e102 req-93e7ebc8-6f8b-471d-ada9-1522f7e4b238 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0569036 Nov 24 11:19:17.897042 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-a2b68a96-6a25-45a5-b970-e07502b0032f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:17.897544 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-a2b68a96-6a25-45a5-b970-e07502b0032f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.86 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 947 time: 0.0491838 Nov 24 11:19:18.008167 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Deleting port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:19:18.008503 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:18.099672 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] For port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:18.100040 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:18.331958 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:18.332446 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:18.332829 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.l3_db [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Floating IP a4bf0df9-92c3-4e36-bb7b-b6727d3a175c disassociated. External IP: 172.27.3.239, port: ebbec69a-2982-4fe3-b07d-5326d6b7f5f3. Nov 24 11:19:18.333250 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Calling delete_port for ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:19:18.490479 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3ccaf10-4b5b-4bc3-a276-e25a6cc37a96 req-fd75b2f9-4f01-4816-a27a-785763621a38 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:18.492030 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a3ccaf10-4b5b-4bc3-a276-e25a6cc37a96 req-fd75b2f9-4f01-4816-a27a-785763621a38 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 947 time: 0.0484931 Nov 24 11:19:18.539536 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:18.552984 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a3ccaf10-4b5b-4bc3-a276-e25a6cc37a96 req-3cc2a9af-08d8-4103-985c-3bf02e7ed667 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=88c1dfcd-809d-471e-ae01-5627ef698662&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503616 Nov 24 11:19:18.570973 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event deleted for resources: {'Port': ['ID=ebbec69a-2982-4fe3-b07d-5326d6b7f5f3,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:18.695048 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Router 7bb4df85-5735-4ea8-9136-d2387a677310 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:19:18.808378 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58628) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:18.819219 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:19:18.833402 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dc44e36-3b94-485c-b709-4d7c4321b360 None None] Sync routers for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:19:18.843005 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dc44e36-3b94-485c-b709-4d7c4321b360 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:18.843919 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-8dc44e36-3b94-485c-b709-4d7c4321b360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:18.863268 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] No DVR routers for this DVR port ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:19:18.865852 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:18.869467 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-277f91bf-70c1-4cea-ae72-8f17f0ce48b7 req-69bcee96-f317-4a96-a447-4f13ab9bc88e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.86 "DELETE /v2.0/ports/ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 HTTP/1.1" status: 204 len: 173 time: 0.9637678 Nov 24 11:19:18.869943 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'name': 'network-vif-deleted', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:19:18.881054 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-05042831-0a78-4b48-87d9-da24ba4e9242" -d '{"events": [{"server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "name": "network-vif-deleted", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:19:18.924668 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37124abb-9be1-48a6-b28a-bd326570a5dd req-3607dfcd-874d-441c-bc20-35868f8686e5 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:18.928938 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-37124abb-9be1-48a6-b28a-bd326570a5dd req-3607dfcd-874d-441c-bc20-35868f8686e5 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0688660 Nov 24 11:19:18.937232 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:19:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-75afda9d-be93-48fa-897c-efa995b49f53 x-openstack-request-id: req-75afda9d-be93-48fa-897c-efa995b49f53 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:19:18.937751 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "54cca4b1-6845-4546-98db-5445a16b80d1", "name": "network-vif-deleted", "tag": "ebbec69a-2982-4fe3-b07d-5326d6b7f5f3", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:19:18.937751 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-75afda9d-be93-48fa-897c-efa995b49f53 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:19:18.938756 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '54cca4b1-6845-4546-98db-5445a16b80d1', 'name': 'network-vif-deleted', 'tag': 'ebbec69a-2982-4fe3-b07d-5326d6b7f5f3', 'status': 'completed', 'code': 200} Nov 24 11:19:18.996991 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-8dc44e36-3b94-485c-b709-4d7c4321b360 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:19.009704 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f85f5c3d-2af7-40d7-991c-92b7efbb749c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:19.023637 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-37124abb-9be1-48a6-b28a-bd326570a5dd req-c54d8035-9714-43c8-907f-06e5d49be4a3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0856450 Nov 24 11:19:19.102987 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f85f5c3d-2af7-40d7-991c-92b7efbb749c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:19.213910 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f85f5c3d-2af7-40d7-991c-92b7efbb749c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:19.215275 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-8dc44e36-3b94-485c-b709-4d7c4321b360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:19.246871 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dc44e36-3b94-485c-b709-4d7c4321b360 None None] Checking router: 7bb4df85-5735-4ea8-9136-d2387a677310 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:19:19.252592 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85f5c3d-2af7-40d7-991c-92b7efbb749c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fdfdb43d-5efc-4635-bbc8-0a0b8f844bd8,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:19.257160 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8dc44e36-3b94-485c-b709-4d7c4321b360 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:19.257327 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-f85f5c3d-2af7-40d7-991c-92b7efbb749c admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=75a2c3090729408982163da4aab008d5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4477963 Nov 24 11:19:19.258057 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-8dc44e36-3b94-485c-b709-4d7c4321b360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:19.260024 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58634) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:19.322923 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-bea3dccd-3480-4c3f-8230-766e3cffa50d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:19.345692 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-bea3dccd-3480-4c3f-8230-766e3cffa50d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:19.371191 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-8dc44e36-3b94-485c-b709-4d7c4321b360 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:19.476633 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-bea3dccd-3480-4c3f-8230-766e3cffa50d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:19.479375 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-bea3dccd-3480-4c3f-8230-766e3cffa50d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:19.480534 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-bea3dccd-3480-4c3f-8230-766e3cffa50d admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/fdfdb43d-5efc-4635-bbc8-0a0b8f844bd8 HTTP/1.1" status: 204 len: 168 time: 0.2194946 Nov 24 11:19:19.489249 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bea3dccd-3480-4c3f-8230-766e3cffa50d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdfdb43d-5efc-4635-bbc8-0a0b8f844bd8,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:19.591741 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-8dc44e36-3b94-485c-b709-4d7c4321b360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:19.621587 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8dc44e36-3b94-485c-b709-4d7c4321b360 None None] The sync data for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi is: [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:19:19.729877 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1dc2f7ac-a1eb-4646-89b1-cb1e205acf34 req-9072171b-24c9-4c81-a275-41c41a915712 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=54cca4b1-6845-4546-98db-5445a16b80d1 HTTP/1.1" status: 200 len: 210 time: 0.0382457 Nov 24 11:19:19.972133 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cf6ae0b3-8a55-4ca0-a0e6-e813125ba450 None None] New status for floating IP a4bf0df9-92c3-4e36-bb7b-b6727d3a175c: DOWN {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:19:20.174965 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2f5a4cc-bf73-4749-807e-ead81efb1317 req-17bc175b-085a-4a75-9da1-38b3c25a19c9 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:20.176752 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d2f5a4cc-bf73-4749-807e-ead81efb1317 req-17bc175b-085a-4a75-9da1-38b3c25a19c9 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0692136 Nov 24 11:19:20.219240 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58660) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:20.275331 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d2f5a4cc-bf73-4749-807e-ead81efb1317 req-9c65ea3f-72a6-4373-a3be-d32bc20a15c1 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0852878 Nov 24 11:19:20.343382 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-374c818c-54cd-4086-bc0d-2fddc7c9212b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:20.428687 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-374c818c-54cd-4086-bc0d-2fddc7c9212b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:20.511052 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-374c818c-54cd-4086-bc0d-2fddc7c9212b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:20.550291 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-374c818c-54cd-4086-bc0d-2fddc7c9212b admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=df71bbbfd3544013a13b3dd0e179fe36&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3284526 Nov 24 11:19:20.552235 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-374c818c-54cd-4086-bc0d-2fddc7c9212b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5735c3ec-ceec-4940-96d3-647657a069a9,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:20.553084 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58670) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:20.606034 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d891f40f-a1f9-4797-8ed9-2202b4c44b2a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:20.629283 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d891f40f-a1f9-4797-8ed9-2202b4c44b2a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:20.683703 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58674) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:20.739564 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d891f40f-a1f9-4797-8ed9-2202b4c44b2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:20.742432 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d891f40f-a1f9-4797-8ed9-2202b4c44b2a admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:20.743739 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-d891f40f-a1f9-4797-8ed9-2202b4c44b2a admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/5735c3ec-ceec-4940-96d3-647657a069a9 HTTP/1.1" status: 204 len: 168 time: 0.1892729 Nov 24 11:19:20.762845 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d891f40f-a1f9-4797-8ed9-2202b4c44b2a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5735c3ec-ceec-4940-96d3-647657a069a9,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:20.801362 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1685981445-network', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:20.933507 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Made reservation on behalf of 89e9b1abd4814b03ae8c95c5918bef03 for: {'network': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:19:20.936435 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:20.942204 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58684) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:20.950990 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.021953 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-887ed6e0-79b8-480a-83e5-0d5718885687 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.032683 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.055652 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-887ed6e0-79b8-480a-83e5-0d5718885687 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.082285 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.111978 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1239} {{(pid=103244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:19:21.121285 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6769c3c7-2437-42b9-b37d-db7211ed255c,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:21.129118 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.129563 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.segments_db [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Added segment 8a5c6583-f0d2-4382-9e2b-b92e582459b2 of type vlan for network 6b81a015-9685-4892-8d78-2a713f48dc53 Nov 24 11:19:21.175226 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.185300 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-887ed6e0-79b8-480a-83e5-0d5718885687 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.188214 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-887ed6e0-79b8-480a-83e5-0d5718885687 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.190586 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-887ed6e0-79b8-480a-83e5-0d5718885687 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "DELETE /v2.0/security-groups/88c1dfcd-809d-471e-ae01-5627ef698662 HTTP/1.1" status: 204 len: 168 time: 0.2464492 Nov 24 11:19:21.198926 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58692) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:21.199761 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-887ed6e0-79b8-480a-83e5-0d5718885687 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=88c1dfcd-809d-471e-ae01-5627ef698662,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:21.216267 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.api.v2.resource [None req-2f8cfde7-230d-4cc3-ac38-e8c0e703c64a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] show failed (client error): The resource could not be found. Nov 24 11:19:21.217294 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2f8cfde7-230d-4cc3-ac38-e8c0e703c64a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups/88c1dfcd-809d-471e-ae01-5627ef698662 HTTP/1.1" status: 404 len: 347 time: 0.0174632 Nov 24 11:19:21.220858 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58694) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:21.271267 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.271988 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:21.272588 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.331361 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:19:21.338691 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] Pushing event updated for resources: {'Network': ['ID=6b81a015-9685-4892-8d78-2a713f48dc53,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:21.356878 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-ac0885f2-d85f-4f10-bcde-634bb1294436 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Deleting port 6c699279-7167-474a-a37b-dab7487bbf4b {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:19:21.357411 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ac0885f2-d85f-4f10-bcde-634bb1294436 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.359858 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 6b81a015-9685-4892-8d78-2a713f48dc53 details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:19:21.363652 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:19:21.363999 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device ebbec69a-2982-4fe3-b07d-5326d6b7f5f3 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:19:21.396532 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-9559c233-5f30-49cd-b7b5-ce65cbbc8a63 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.7116039 Nov 24 11:19:21.412990 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-672360e7-3a52-47a7-bd25-af91b08de99e req-6f061bac-3057-4259-b48a-cecf7f08c305 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:21.414588 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-672360e7-3a52-47a7-bd25-af91b08de99e req-6f061bac-3057-4259-b48a-cecf7f08c305 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0734882 Nov 24 11:19:21.415055 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58702) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:21.419762 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-9ce5cc2a-a61b-45af-8706-15ca24b53f5d admin admin] Request body: {'subnet': {'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1685981445-subnet', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'ip_version': 4}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:21.457702 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ac0885f2-d85f-4f10-bcde-634bb1294436 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.458027 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ac0885f2-d85f-4f10-bcde-634bb1294436 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.477129 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-ac0885f2-d85f-4f10-bcde-634bb1294436 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Calling delete_port for 6c699279-7167-474a-a37b-dab7487bbf4b owned by network:floatingip {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:19:21.502806 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-672360e7-3a52-47a7-bd25-af91b08de99e req-714c0060-f9dc-48e0-b06d-483ca3dc2985 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0788646 Nov 24 11:19:21.539664 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9ce5cc2a-a61b-45af-8706-15ca24b53f5d admin admin] Made reservation on behalf of 89e9b1abd4814b03ae8c95c5918bef03 for: {'subnet': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:19:21.544512 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9ce5cc2a-a61b-45af-8706-15ca24b53f5d admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8480549'] for subnet, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.728263 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ac0885f2-d85f-4f10-bcde-634bb1294436 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.755313 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac0885f2-d85f-4f10-bcde-634bb1294436 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event deleted for resources: {'Port': ['ID=6c699279-7167-474a-a37b-dab7487bbf4b,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:21.808383 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9ce5cc2a-a61b-45af-8706-15ca24b53f5d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8698972', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8480535'] for subnet, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.819219 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ac0885f2-d85f-4f10-bcde-634bb1294436 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.822114 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ac0885f2-d85f-4f10-bcde-634bb1294436 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:21.826562 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-ac0885f2-d85f-4f10-bcde-634bb1294436 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "DELETE /v2.0/floatingips/a4bf0df9-92c3-4e36-bb7b-b6727d3a175c HTTP/1.1" status: 204 len: 168 time: 0.6010149 Nov 24 11:19:21.864977 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ce5cc2a-a61b-45af-8706-15ca24b53f5d admin admin] Pushing event updated for resources: {'Subnet': ['ID=2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:21.886696 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9ce5cc2a-a61b-45af-8706-15ca24b53f5d admin admin] Checking segment: {'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:19:21.887070 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ce5cc2a-a61b-45af-8706-15ca24b53f5d admin admin] Network hostable DHCP agents. Network: 6b81a015-9685-4892-8d78-2a713f48dc53, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:19:21.974396 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ce5cc2a-a61b-45af-8706-15ca24b53f5d admin admin] Network 6b81a015-9685-4892-8d78-2a713f48dc53 is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:19:22.042183 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-9ce5cc2a-a61b-45af-8706-15ca24b53f5d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 6b81a015-9685-4892-8d78-2a713f48dc53) {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:22.046263 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ce5cc2a-a61b-45af-8706-15ca24b53f5d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:22.046770 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9ce5cc2a-a61b-45af-8706-15ca24b53f5d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.053205 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2cb97232-3f12-425c-b650-38df1cf6434d None None] Network 6b81a015-9685-4892-8d78-2a713f48dc53 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:19:22.135441 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-9ce5cc2a-a61b-45af-8706-15ca24b53f5d admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.7191594 Nov 24 11:19:22.138042 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58718) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:22.142526 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:22.216971 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1e1181f3-c521-552f-a8c5-b0ec988a193c-6b81a015-9685-4892-8d78-2a713f48dc53', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'fixed_ips': [{'subnet_id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c'}]}} from dv-cinder-804035-18-iscsi. {{(pid=103245) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 11:19:22.217940 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.230795 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58720) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:22.235587 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-4b6390ae-8fe2-45f1-a08e-8c86a19513b9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Request body: {'security_group': {'name': 'tempest-securitygroup--467657675', 'description': 'tempest-description--254333696'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:22.259377 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1010094', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.260389 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1009794', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-534758', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-985777', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-654'] for router, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.321354 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.346324 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4b6390ae-8fe2-45f1-a08e-8c86a19513b9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.357308 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.db_base_plugin_common [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Allocated IP 172.20.0.2 (6b81a015-9685-4892-8d78-2a713f48dc53/2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c/9e79b152-3919-43a2-90d9-08174e4707be) {{(pid=103245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:19:22.473060 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4b6390ae-8fe2-45f1-a08e-8c86a19513b9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.498594 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Publish callbacks [] for port, precommit_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.541594 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4b6390ae-8fe2-45f1-a08e-8c86a19513b9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.557223 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.562231 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.579505 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b6390ae-8fe2-45f1-a08e-8c86a19513b9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event updated for resources: {'SecurityGroup': ['ID=064a1953-b8d0-4c91-993b-f0605de9a95a,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:22.612795 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Network 6b81a015-9685-4892-8d78-2a713f48dc53 is already hosted by enough agents. {{(pid=103245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:19:22.614250 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.base_scheduler [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Resources bound (agent type, host, resource id): {{(pid=103245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:22.616974 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Received port after_create {{(pid=103245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:19:22.640199 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02b924c9-f0c1-40ac-b104-9c65058efedb req-63eaf76b-d5bc-4c1a-9c08-2f51380bc26b tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:22.642682 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-02b924c9-f0c1-40ac-b104-9c65058efedb req-63eaf76b-d5bc-4c1a-9c08-2f51380bc26b tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0602243 Nov 24 11:19:22.659650 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4b6390ae-8fe2-45f1-a08e-8c86a19513b9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.661567 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-4b6390ae-8fe2-45f1-a08e-8c86a19513b9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.4294405 Nov 24 11:19:22.664169 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58734) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:22.666485 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Pushing event updated for resources: {'Port': ['ID=9e79b152-3919-43a2-90d9-08174e4707be,revision_number=1']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:22.668798 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-7516a5ea-a8b1-4354-bf57-095072150865 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Request body: {'security_group_rule': {'security_group_id': '064a1953-b8d0-4c91-993b-f0605de9a95a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:22.690629 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:22.691349 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:22.691856 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:22.692341 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:22.692811 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:22.693315 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:22.693820 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:22.694151 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:22.694494 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:22.694816 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:22.695304 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:22.695793 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:22.710730 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Attempting to bind port 9e79b152-3919-43a2-90d9-08174e4707be on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:19:22.711347 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Attempting to bind port 9e79b152-3919-43a2-90d9-08174e4707be by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:19:22.711989 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Attempting to bind port 9e79b152-3919-43a2-90d9-08174e4707be on network 6b81a015-9685-4892-8d78-2a713f48dc53 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:19:22.717887 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 19, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:19:22.718955 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Checking segment: {'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:19:22.719368 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-02b924c9-f0c1-40ac-b104-9c65058efedb req-48165623-963c-4f54-8a38-bfba349a6e86 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0698929 Nov 24 11:19:22.727167 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.730812 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Bound using segment: {'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:19:22.731346 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Bound port: 9e79b152-3919-43a2-90d9-08174e4707be, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:19:22.731933 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.814707 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] For port 9e79b152-3919-43a2-90d9-08174e4707be, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:19:22.817906 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] For port 9e79b152-3919-43a2-90d9-08174e4707be, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9e79b152-3919-43a2-90d9-08174e4707be,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:19:22.854442 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7516a5ea-a8b1-4354-bf57-095072150865 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.865707 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.928690 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.930231 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88d977ea-0c2d-4e5c-8fbe-ec08d4c9b19c None None] Pushing event updated for resources: {'Port': ['ID=9e79b152-3919-43a2-90d9-08174e4707be,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:22.963984 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:22.971988 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7516a5ea-a8b1-4354-bf57-095072150865 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:23.056051 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7516a5ea-a8b1-4354-bf57-095072150865 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:23.085507 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7516a5ea-a8b1-4354-bf57-095072150865 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4d9a84c6-e240-44a2-8d7a-6d57a88380bd,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:23.122828 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Allocated IP 172.27.3.36 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/b04704b9-716b-4043-b41c-569809c4e9ce) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:19:23.432670 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7516a5ea-a8b1-4354-bf57-095072150865 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:23.433843 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-7516a5ea-a8b1-4354-bf57-095072150865 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7686405 Nov 24 11:19:23.436877 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58746) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:23.442101 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-5bb7ec28-a7ce-4345-ad62-85b0ef258637 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Request body: {'security_group_rule': {'security_group_id': '064a1953-b8d0-4c91-993b-f0605de9a95a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:23.472233 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:23.555959 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5bb7ec28-a7ce-4345-ad62-85b0ef258637 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:23.574106 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:23.605570 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5bb7ec28-a7ce-4345-ad62-85b0ef258637 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:23.617457 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:19:23.620421 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:23.624077 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:19:23.629855 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Pushing event updated for resources: {'Port': ['ID=b04704b9-716b-4043-b41c-569809c4e9ce,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:23.695180 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5bb7ec28-a7ce-4345-ad62-85b0ef258637 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:23.725979 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bb7ec28-a7ce-4345-ad62-85b0ef258637 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=406a9630-c31b-4528-b312-f9228bc9fb26,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:23.810400 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5bb7ec28-a7ce-4345-ad62-85b0ef258637 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:23.815063 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58752) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:23.815217 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-5bb7ec28-a7ce-4345-ad62-85b0ef258637 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3769560 Nov 24 11:19:23.819617 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Request body: {'floatingip': {'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:23.854409 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64e1ed17-0509-4308-a7ec-f1711c2b0f72 req-06b20871-b01e-4556-8dcc-03efffadeb5a tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:23.855916 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-64e1ed17-0509-4308-a7ec-f1711c2b0f72 req-06b20871-b01e-4556-8dcc-03efffadeb5a tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0590615 Nov 24 11:19:23.922043 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-64e1ed17-0509-4308-a7ec-f1711c2b0f72 req-05cc59fa-1a33-4de8-b61c-7be23a2977f1 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0592136 Nov 24 11:19:23.933588 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:23.954608 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f97f7dac-ff10-452a-a416-430a63f4a6af None None] Network 6b81a015-9685-4892-8d78-2a713f48dc53 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:19:24.030738 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-01bf313d-a377-4f9e-a416-6d2bcf1039e8 None None] Provisioning complete for port 9e79b152-3919-43a2-90d9-08174e4707be triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:24.031098 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-01bf313d-a377-4f9e-a416-6d2bcf1039e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:24.054861 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:24.167761 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:24.287255 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-01bf313d-a377-4f9e-a416-6d2bcf1039e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:24.324093 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-01bf313d-a377-4f9e-a416-6d2bcf1039e8 None None] For port 9e79b152-3919-43a2-90d9-08174e4707be, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9e79b152-3919-43a2-90d9-08174e4707be,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:24.346739 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1009813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-942685'] for router, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:24.404748 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Allocated IP 172.27.3.74 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/77168c31-b9a3-41ea-bd2c-184bd32680f4) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:19:24.420727 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-01bf313d-a377-4f9e-a416-6d2bcf1039e8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:24.484708 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01bf313d-a377-4f9e-a416-6d2bcf1039e8 None None] Pushing event updated for resources: {'Port': ['ID=9e79b152-3919-43a2-90d9-08174e4707be,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:24.542664 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-05ab46d5-0348-4b23-b5e2-2dc41c64cf9f None None] Provisioning complete for port 9e79b152-3919-43a2-90d9-08174e4707be triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:24.543033 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-05ab46d5-0348-4b23-b5e2-2dc41c64cf9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:24.581042 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:24.681015 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Router 98c34a41-9cdb-48f6-bfa4-2ed94016563f is scheduled to L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 with binding_index 1 {{(pid=103243) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 11:19:24.683321 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:24.725722 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:19:24.733697 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:24.765987 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:19:24.794643 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event updated for resources: {'Port': ['ID=77168c31-b9a3-41ea-bd2c-184bd32680f4,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:24.896172 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:19:24.905158 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Sync routers for ids ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:19:24.911261 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:24.916078 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Routers {'98c34a41-9cdb-48f6-bfa4-2ed94016563f'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:24.916694 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:25.005825 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] Publish callbacks [] for router, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.007356 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-7d4f1895-76a8-4c38-807d-af84b1575137 admin admin] 10.222.0.76 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.8682675 Nov 24 11:19:25.018403 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58760) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:25.055848 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Set router 98c34a41-9cdb-48f6-bfa4-2ed94016563f gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:25.059729 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d02370a-e817-4664-8492-97e634b80fff req-80c8fd99-f100-45e4-be36-d841acd2eb3d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:25.084997 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4d02370a-e817-4664-8492-97e634b80fff req-80c8fd99-f100-45e4-be36-d841acd2eb3d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0796931 Nov 24 11:19:25.135335 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.178468 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9e79b152-3919-43a2-90d9-08174e4707be up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:19:25.183969 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4d02370a-e817-4664-8492-97e634b80fff req-e9f5873b-6c8d-49d8-a513-b40215809cbc tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0993319 Nov 24 11:19:25.280279 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 9e79b152-3919-43a2-90d9-08174e4707be triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:25.280565 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.333006 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:23Z', 'revision_number': 3, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:23Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:25.365054 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Checking router: 98c34a41-9cdb-48f6-bfa4-2ed94016563f for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:19:25.365406 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Updating router 98c34a41-9cdb-48f6-bfa4-2ed94016563f port b04704b9-716b-4043-b41c-569809c4e9ce binding host dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:19:25.410389 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.494383 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.577649 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.666581 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Publish callbacks [] for port, precommit_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.676227 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event updated for resources: {'Port': ['ID=77168c31-b9a3-41ea-bd2c-184bd32680f4,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:25.699116 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.710244 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.744925 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.800315 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5275047d-a294-4b89-9eba-59aef7bc5eb3 None None] Pushing event updated for resources: {'Port': ['ID=b04704b9-716b-4043-b41c-569809c4e9ce,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:25.802588 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Attempting to bind port b04704b9-716b-4043-b41c-569809c4e9ce on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:19:25.808079 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Attempting to bind port b04704b9-716b-4043-b41c-569809c4e9ce by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:19:25.808079 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Attempting to bind port b04704b9-716b-4043-b41c-569809c4e9ce on network fa6231d1-a629-42bc-a091-20035dee3542 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:19:25.809634 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 19, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:19:25.810016 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Checking segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:19:25.810199 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.810414 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.810801 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Bound using segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:19:25.811267 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Bound port: b04704b9-716b-4043-b41c-569809c4e9ce, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:19:25.811406 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-247a8bc6-e294-4560-9f54-9d0d6f9d39dd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.9954994 Nov 24 11:19:25.811789 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:25.868860 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] For port b04704b9-716b-4043-b41c-569809c4e9ce, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:19:25.872266 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] For port b04704b9-716b-4043-b41c-569809c4e9ce, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=b04704b9-716b-4043-b41c-569809c4e9ce,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:19:25.880466 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Allocated IP 172.20.0.1 (6b81a015-9685-4892-8d78-2a713f48dc53/2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c/f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:19:25.958733 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:26.002861 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:26.021795 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Routers {'98c34a41-9cdb-48f6-bfa4-2ed94016563f'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:26.022575 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:26.024397 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5275047d-a294-4b89-9eba-59aef7bc5eb3 None None] Pushing event updated for resources: {'Port': ['ID=b04704b9-716b-4043-b41c-569809c4e9ce,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:26.031968 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-473d5819-297f-465b-95df-d6bcc9616da7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?name=tempest-securitygroup--467657675&fields=id&tenant_id=70ea7b83799640618db2c87847a8ecea HTTP/1.1" status: 200 len: 267 time: 0.0550563 Nov 24 11:19:26.115719 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:26.136916 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] Set router 98c34a41-9cdb-48f6-bfa4-2ed94016563f gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:26.146493 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-8ef60759-5b6f-4b55-92fd-c73677557983 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:26.148755 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-8ef60759-5b6f-4b55-92fd-c73677557983 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 817 time: 0.1139932 Nov 24 11:19:26.162370 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Network 6b81a015-9685-4892-8d78-2a713f48dc53 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:19:26.167514 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:26.171533 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:19:26.177807 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-918bc4e7-06e2-4d6e-8d0c-a130fd6e8ebc tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/quotas/70ea7b83799640618db2c87847a8ecea HTTP/1.1" status: 200 len: 375 time: 0.0209181 Nov 24 11:19:26.204712 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Pushing event updated for resources: {'Port': ['ID=f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:26.231478 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1009482'] for router_interface, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:26.248584 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-c87a73c9-7f12-4f43-9ecc-deb6106c6eaf tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0696964 Nov 24 11:19:26.399416 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:23Z', 'revision_number': 3, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:26.428517 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ba9606-5d45-42bd-ac82-013f9b1cebdd req-29630f4a-e5a5-4f32-b5b1-6a7d062bd3b8 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:26.430176 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-66ba9606-5d45-42bd-ac82-013f9b1cebdd req-29630f4a-e5a5-4f32-b5b1-6a7d062bd3b8 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.1444972 Nov 24 11:19:26.440251 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8969549-be7a-402a-934b-8c547fb95d9b None None] The sync data for ids ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'] in dv-cinder-804035-18-iscsi is: [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:23Z', 'revision_number': 3, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:25Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:19:26.450135 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:26.473941 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-b38e1c8c-8efa-4433-be1b-0c03fad7aaec service neutron] 10.222.0.76 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2229009 Nov 24 11:19:26.569804 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-8f3b91a0-f605-46dc-b33e-0e2d4182b532 None None] Provisioning complete for port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:26.570357 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-8f3b91a0-f605-46dc-b33e-0e2d4182b532 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:26.583750 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-66ba9606-5d45-42bd-ac82-013f9b1cebdd req-6fc7b5c0-8f9a-4716-86b4-1f27c6efe9a3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1464629 Nov 24 11:19:26.614685 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-740caf50-0563-494e-abbf-700648e528be service neutron] 10.222.0.76 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1393864 Nov 24 11:19:26.623383 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-8f3b91a0-f605-46dc-b33e-0e2d4182b532 None None] Port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:19:27.005829 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c05881ca-171e-4656-9cde-c62594a5ab8e req-1dc662d5-9fd7-4017-a6b1-0e6d07227a51 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 210 time: 0.0862739 Nov 24 11:19:27.028709 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:27.115705 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:27.169677 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device b04704b9-716b-4043-b41c-569809c4e9ce up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:19:27.194446 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-636370', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1009638'] for router_interface, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:27.196310 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Pushing event updated for resources: {'Port': ['ID=f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:27.237324 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port b04704b9-716b-4043-b41c-569809c4e9ce triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:27.237736 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:27.301657 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Network 6b81a015-9685-4892-8d78-2a713f48dc53 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:19:27.303422 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:27.323695 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:27.347933 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] For port b04704b9-716b-4043-b41c-569809c4e9ce, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=b04704b9-716b-4043-b41c-569809c4e9ce,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:27.420496 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:27.452653 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Router 98c34a41-9cdb-48f6-bfa4-2ed94016563f has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:19:27.481240 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Pushing event updated for resources: {'Port': ['ID=b04704b9-716b-4043-b41c-569809c4e9ce,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:27.554389 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-4bc48d4a-9dfb-470d-a28a-4d0ee6c855d8 None None] Provisioning complete for port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:27.555154 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4bc48d4a-9dfb-470d-a28a-4d0ee6c855d8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:27.580335 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:19:27.587740 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-306f1967-91b9-44a8-b4a3-478ed71bef31 admin admin] 10.222.0.76 "PUT /v2.0/routers/98c34a41-9cdb-48f6-bfa4-2ed94016563f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5753894 Nov 24 11:19:27.597546 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-4bc48d4a-9dfb-470d-a28a-4d0ee6c855d8 None None] Port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:19:27.716114 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8126f10-787a-4a9a-905b-f98b9c7542f3 req-76614422-f642-4c1e-b6b4-32f0c298f834 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:27.718388 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c8126f10-787a-4a9a-905b-f98b9c7542f3 req-76614422-f642-4c1e-b6b4-32f0c298f834 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0540791 Nov 24 11:19:27.795124 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c8126f10-787a-4a9a-905b-f98b9c7542f3 req-b4a02c9f-1e12-4285-8d32-825f9d6463f0 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0686398 Nov 24 11:19:28.126389 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0e778ff3-f334-4a2d-a3a3-33ce611c5049 req-46dde1e9-50af-47f5-80e5-7397983fa1ff tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 210 time: 0.0399830 Nov 24 11:19:28.255980 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Sync routers for ids ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:19:28.260404 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Routers {'98c34a41-9cdb-48f6-bfa4-2ed94016563f'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:28.261017 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:28.382694 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Set router 98c34a41-9cdb-48f6-bfa4-2ed94016563f gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:28.439459 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58832) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:28.445503 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1190328099-network', 'tenant_id': '02eceba9328941719d32211c28e13ae0'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:28.528482 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Made reservation on behalf of 02eceba9328941719d32211c28e13ae0 for: {'network': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:19:28.531614 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:28.543059 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:28.606076 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:26Z', 'revision_number': 4, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': 'f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d', 'name': '', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'mac_address': 'fa:16:3e:5e:d7:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:25Z', 'updated_at': '2021-11-24T11:19:26Z', 'revision_number': 2, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'subnets': [{'id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:28.622410 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:28.632879 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Checking router: 98c34a41-9cdb-48f6-bfa4-2ed94016563f for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:19:28.633232 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Updating router 98c34a41-9cdb-48f6-bfa4-2ed94016563f port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d binding host dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:19:28.658045 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:28.733457 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:28.758485 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1212} {{(pid=103243) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:19:28.767467 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3449a59b-8f0b-4c2f-8cef-72954554a796,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:28.774929 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:28.775568 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.segments_db [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Added segment 78c61401-1987-4f48-8774-c9e7053eb1b3 of type vlan for network 73fc50e3-6c8b-4fe1-bb1e-2972356190e5 Nov 24 11:19:28.829994 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:28.934379 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe751d11-8413-4105-bfd7-81b14b0ac634 req-71f694da-3ba0-4d79-9eb9-dfbd1fc8d5ca tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:28.935896 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fe751d11-8413-4105-bfd7-81b14b0ac634 req-71f694da-3ba0-4d79-9eb9-dfbd1fc8d5ca tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0556138 Nov 24 11:19:28.946189 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Publish callbacks [] for port, precommit_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:28.973508 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:28.974598 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:28.975363 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:29.017572 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fe751d11-8413-4105-bfd7-81b14b0ac634 req-707dfcea-6df2-408d-b1b3-82fc256752da tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0735657 Nov 24 11:19:29.047348 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:29.051611 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device b04704b9-716b-4043-b41c-569809c4e9ce up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:19:29.085557 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] Pushing event updated for resources: {'Network': ['ID=73fc50e3-6c8b-4fe1-bb1e-2972356190e5,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:29.097996 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Pushing event updated for resources: {'Port': ['ID=f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d,revision_number=3']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:29.119117 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-20f95d89-fb2e-41d8-91b4-516145524327 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:29.119886 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:29.120421 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:29.120676 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-20f95d89-fb2e-41d8-91b4-516145524327 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.86 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 817 time: 0.1722026 Nov 24 11:19:29.121095 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:29.121455 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:29.121786 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:29.122129 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:29.122458 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:29.122778 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:29.123463 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:29.125307 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:29.125797 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:29.126251 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:29.149815 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 73fc50e3-6c8b-4fe1-bb1e-2972356190e5 details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:19:29.195904 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Attempting to bind port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:19:29.196543 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Attempting to bind port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:19:29.197410 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Attempting to bind port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d on network 6b81a015-9685-4892-8d78-2a713f48dc53 {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:19:29.206316 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 19, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:19:29.206698 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Checking segment: {'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:19:29.207107 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:29.207521 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Bound using segment: {'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:19:29.208194 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Bound port: f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'}}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:19:29.209392 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:29.233548 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port b04704b9-716b-4043-b41c-569809c4e9ce triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:29.234213 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:29.247479 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-f525d5c6-1825-433e-89ac-2e12532955cf tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=70ea7b83799640618db2c87847a8ecea HTTP/1.1" status: 200 len: 379 time: 0.1162224 Nov 24 11:19:29.252158 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-88863d61-2c46-4a5b-905f-1e4329b244d5 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.8105996 Nov 24 11:19:29.257950 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Request body: {'port': {'device_id': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'admin_state_up': True, 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'security_groups': ['064a1953-b8d0-4c91-993b-f0605de9a95a']}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:29.261201 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58848) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:29.278198 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-c6b15950-80a6-49c4-8272-0f078faeac9e admin admin] Request body: {'subnet': {'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1190328099-subnet', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'ip_version': 4}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:29.301306 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-40b082f7-9a7f-47c6-89b1-23f8fda8997f req-34a0be77-b954-40ce-933e-0ad667d26e4a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 210 time: 0.0633240 Nov 24 11:19:29.428383 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] For port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:19:29.429892 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-fd0c842a-6a99-488e-b74e-7c2fb9c6de75 None None] Provisioning complete for port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:29.430258 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fd0c842a-6a99-488e-b74e-7c2fb9c6de75 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:29.432142 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] For port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:19:29.451731 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c6b15950-80a6-49c4-8272-0f078faeac9e admin admin] Made reservation on behalf of 02eceba9328941719d32211c28e13ae0 for: {'subnet': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:19:29.454916 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c6b15950-80a6-49c4-8272-0f078faeac9e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9106670'] for subnet, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:29.466209 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-fd0c842a-6a99-488e-b74e-7c2fb9c6de75 None None] Port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:19:29.546669 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:29.604195 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Routers {'98c34a41-9cdb-48f6-bfa4-2ed94016563f'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:29.604810 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:29.619416 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Made reservation on behalf of 70ea7b83799640618db2c87847a8ecea for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:19:29.623206 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:29.643990 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47b85c3b-a40c-4039-8b95-146206f4bf4e None None] Pushing event updated for resources: {'Port': ['ID=f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d,revision_number=4']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:29.726396 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] Set router 98c34a41-9cdb-48f6-bfa4-2ed94016563f gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:29.728310 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c6b15950-80a6-49c4-8272-0f078faeac9e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8721775', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9106652'] for subnet, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:29.817862 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Allocated IP 172.20.0.3 (76fcee22-81e5-4608-a546-3b68c56c5ac7/5eae2e87-935a-45b7-89da-586ce04ad644/99ed14d7-8b44-45c2-98b0-6d15ba385922) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:19:29.840922 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6b15950-80a6-49c4-8272-0f078faeac9e admin admin] Pushing event updated for resources: {'Subnet': ['ID=8be715fb-14e8-4c72-8f81-409bf0cdaa60,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:29.853079 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6b15950-80a6-49c4-8272-0f078faeac9e admin admin] Checking segment: {'id': '78c61401-1987-4f48-8774-c9e7053eb1b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1212, 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:19:29.853436 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6b15950-80a6-49c4-8272-0f078faeac9e admin admin] Network hostable DHCP agents. Network: 73fc50e3-6c8b-4fe1-bb1e-2972356190e5, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103243) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:19:29.888607 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-95549fd2-4981-450d-a5d2-e64db98faad6 None None] Provisioning complete for port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:29.889009 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-95549fd2-4981-450d-a5d2-e64db98faad6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:29.957100 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:26Z', 'revision_number': 4, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': 'f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d', 'name': '', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'mac_address': 'fa:16:3e:5e:d7:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:25Z', 'updated_at': '2021-11-24T11:19:29Z', 'revision_number': 4, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'subnets': [{'id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:29.989919 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-775b3313-6428-4ef9-91b1-6471e75df8c8 None None] The sync data for ids ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'] in dv-cinder-804035-18-iscsi is: [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:26Z', 'revision_number': 4, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': 'f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d', 'name': '', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'mac_address': 'fa:16:3e:5e:d7:3f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:25Z', 'updated_at': '2021-11-24T11:19:29Z', 'revision_number': 4, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'subnets': [{'id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:19:30.041486 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.067145 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c6b15950-80a6-49c4-8272-0f078faeac9e admin admin] Network 73fc50e3-6c8b-4fe1-bb1e-2972356190e5 is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103243) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:19:30.158283 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-c6b15950-80a6-49c4-8272-0f078faeac9e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 73fc50e3-6c8b-4fe1-bb1e-2972356190e5) {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:30.169755 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c6b15950-80a6-49c4-8272-0f078faeac9e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:30.170434 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c6b15950-80a6-49c4-8272-0f078faeac9e admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.170990 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a055fc17-08e5-4afa-9dc3-e093070ddc8c req-28f896e7-e22e-4e71-a5b7-48bb1eda339c tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:30.180134 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a055fc17-08e5-4afa-9dc3-e093070ddc8c req-28f896e7-e22e-4e71-a5b7-48bb1eda339c tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0654311 Nov 24 11:19:30.180375 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90c85fea-ce11-4601-9c2a-4f7ad6b2db87 None None] Network 73fc50e3-6c8b-4fe1-bb1e-2972356190e5 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:19:30.181771 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.194726 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-95549fd2-4981-450d-a5d2-e64db98faad6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.242809 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Network 76fcee22-81e5-4608-a546-3b68c56c5ac7 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:19:30.245800 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event updated for resources: {'Port': ['ID=99ed14d7-8b44-45c2-98b0-6d15ba385922,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:30.250213 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:30.256362 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:19:30.266373 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-c6b15950-80a6-49c4-8272-0f078faeac9e admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.0028069 Nov 24 11:19:30.288958 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a055fc17-08e5-4afa-9dc3-e093070ddc8c req-965fc0a0-d7dd-49c9-987b-454fd618446c tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1064799 Nov 24 11:19:30.289204 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58864) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:30.298570 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1190328099-router', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:30.303803 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-95549fd2-4981-450d-a5d2-e64db98faad6 None None] For port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:30.345913 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:30.345913 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.395007 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-95549fd2-4981-450d-a5d2-e64db98faad6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.424998 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1e1181f3-c521-552f-a8c5-b0ec988a193c-73fc50e3-6c8b-4fe1-bb1e-2972356190e5', 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'fixed_ips': [{'subnet_id': '8be715fb-14e8-4c72-8f81-409bf0cdaa60'}]}} from dv-cinder-804035-18-iscsi. {{(pid=103245) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 11:19:30.425982 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.430621 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1010094', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.432292 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1009794', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-534758', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-985777', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-654'] for router, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.497093 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95549fd2-4981-450d-a5d2-e64db98faad6 None None] Pushing event updated for resources: {'Port': ['ID=f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:30.517100 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.529341 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e6460fe4-f011-409c-a02b-1c96c135c617 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2754426 Nov 24 11:19:30.547582 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Request body: {'port': {'device_id': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:30.663214 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-fcce61d9-7057-4c47-a595-099832411f69 None None] Provisioning complete for port 99ed14d7-8b44-45c2-98b0-6d15ba385922 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:30.663823 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fcce61d9-7057-4c47-a595-099832411f69 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.665915 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.db_base_plugin_common [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Allocated IP 172.20.0.2 (73fc50e3-6c8b-4fe1-bb1e-2972356190e5/8be715fb-14e8-4c72-8f81-409bf0cdaa60/a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65) {{(pid=103245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:19:30.731024 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.747515 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-fcce61d9-7057-4c47-a595-099832411f69 None None] Port 99ed14d7-8b44-45c2-98b0-6d15ba385922 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:19:30.834968 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eb63945-3498-4911-88b6-03b14ee07395 req-f321a27f-769f-4258-8d7f-2d08834a1f29 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:30.836897 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7eb63945-3498-4911-88b6-03b14ee07395 req-f321a27f-769f-4258-8d7f-2d08834a1f29 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 931 time: 0.4244232 Nov 24 11:19:30.860098 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.890838 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7eb63945-3498-4911-88b6-03b14ee07395 req-935730e6-becb-4b64-beb5-c97e29248ffc tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475857 Nov 24 11:19:30.903054 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Publish callbacks [] for port, precommit_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:30.979632 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.041800 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Network 73fc50e3-6c8b-4fe1-bb1e-2972356190e5 is already hosted by enough agents. {{(pid=103245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:19:31.044699 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.base_scheduler [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Resources bound (agent type, host, resource id): {{(pid=103245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:31.050105 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Received port after_create {{(pid=103245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:19:31.053310 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Pushing event updated for resources: {'Port': ['ID=a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65,revision_number=1']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:31.112150 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:19:31.149045 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Attempting to bind port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:19:31.149449 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Attempting to bind port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': '78c61401-1987-4f48-8774-c9e7053eb1b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1212, 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:19:31.149822 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Attempting to bind port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 on network 73fc50e3-6c8b-4fe1-bb1e-2972356190e5 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:19:31.175436 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 19, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:19:31.175436 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Checking segment: {'id': '78c61401-1987-4f48-8774-c9e7053eb1b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1212, 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:19:31.175436 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.175436 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Bound using segment: {'id': '78c61401-1987-4f48-8774-c9e7053eb1b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1212, 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:19:31.175436 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Bound port: a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78c61401-1987-4f48-8774-c9e7053eb1b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1212, 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:19:31.175436 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.176373 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 99ed14d7-8b44-45c2-98b0-6d15ba385922 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:19:31.243358 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.262717 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Transition to ACTIVE for port object 99ed14d7-8b44-45c2-98b0-6d15ba385922 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:19:31.263949 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] For port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:19:31.268044 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] For port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65,segment=NetworkSegment(78c61401-1987-4f48-8774-c9e7053eb1b3),segment_id=78c61401-1987-4f48-8774-c9e7053eb1b3)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:19:31.288168 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:31.289011 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.301912 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.323464 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.371195 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.375063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.492938 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Pushing event updated for resources: {'Port': ['ID=99ed14d7-8b44-45c2-98b0-6d15ba385922,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:31.513209 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99af57be-7560-451c-831a-07d0b851f0b4 req-ced03817-d1d3-43f3-a9a8-5aeea170f9a3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:31.527127 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-99af57be-7560-451c-831a-07d0b851f0b4 req-ced03817-d1d3-43f3-a9a8-5aeea170f9a3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.1253166 Nov 24 11:19:31.554792 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95ca189d-b2b8-4206-87bf-ae9b1083f654 None None] Pushing event updated for resources: {'Port': ['ID=a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:31.575326 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Allocated IP 172.27.3.85 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/a21712de-345b-4141-9d84-af68ebe8dd08) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:19:31.624950 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-99af57be-7560-451c-831a-07d0b851f0b4 req-a3d16db0-9535-439d-83d8-b15cfb55033c tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&id=3447b729-9871-4ac1-9faf-bf8884defce7&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0954962 Nov 24 11:19:31.633747 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Attempting to bind port 99ed14d7-8b44-45c2-98b0-6d15ba385922 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:19:31.634087 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Attempting to bind port 99ed14d7-8b44-45c2-98b0-6d15ba385922 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:19:31.634406 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Attempting to bind port 99ed14d7-8b44-45c2-98b0-6d15ba385922 on network 76fcee22-81e5-4608-a546-3b68c56c5ac7 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:19:31.681261 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Port 99ed14d7-8b44-45c2-98b0-6d15ba385922 on network 76fcee22-81e5-4608-a546-3b68c56c5ac7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:19:31.681520 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Attempting to bind port 99ed14d7-8b44-45c2-98b0-6d15ba385922 on network 76fcee22-81e5-4608-a546-3b68c56c5ac7 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:19:31.692583 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 19, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:19:31.692919 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Checking segment: {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:19:31.693319 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Bound using segment: {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:19:31.693719 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Bound port: 99ed14d7-8b44-45c2-98b0-6d15ba385922, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1229, 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:19:31.694067 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.768946 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.797097 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:19:31.801823 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:19:31.884324 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.917241 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.926943 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:31.927108 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:31.928748 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] 10.222.0.86 "PUT /v2.0/ports/99ed14d7-8b44-45c2-98b0-6d15ba385922 HTTP/1.1" status: 200 len: 1093 time: 1.3859854 Nov 24 11:19:31.935009 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:19:31.937317 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e7af346-9854-4b39-8eab-4dbdba2f44f8" -d '{"events": [{"name": "network-changed", "server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:19:31.959994 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:19:31.962992 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:31.965473 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:19:32.003429 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:19:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6cd316a-7314-425b-84f0-e1aa16c636c7 x-openstack-request-id: req-e6cd316a-7314-425b-84f0-e1aa16c636c7 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:19:32.003429 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:19:32.003429 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-e6cd316a-7314-425b-84f0-e1aa16c636c7 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:19:32.003429 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'status': 'completed', 'code': 200} Nov 24 11:19:32.029884 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4190bda-e2ae-420d-a390-7719baf0b5ce service neutron] Pushing event updated for resources: {'Port': ['ID=99ed14d7-8b44-45c2-98b0-6d15ba385922,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:32.069272 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-084beeda-bc36-4afa-98d0-d6e2d3cbd5f4 req-c407a9d9-ca33-415f-987f-fde7f4c51c48 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:32.071056 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-084beeda-bc36-4afa-98d0-d6e2d3cbd5f4 req-c407a9d9-ca33-415f-987f-fde7f4c51c48 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0823576 Nov 24 11:19:32.139727 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-084beeda-bc36-4afa-98d0-d6e2d3cbd5f4 req-f838a2b1-7843-400d-ba0c-c290f140bbfc tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0616860 Nov 24 11:19:32.178504 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Pushing event updated for resources: {'Port': ['ID=a21712de-345b-4141-9d84-af68ebe8dd08,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:32.209976 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7af346-9854-4b39-8eab-4dbdba2f44f8 req-655745e1-8023-4b63-b966-7b8601b118a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:32.211543 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e7af346-9854-4b39-8eab-4dbdba2f44f8 req-655745e1-8023-4b63-b966-7b8601b118a6 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 1096 time: 0.1914096 Nov 24 11:19:32.322189 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7af346-9854-4b39-8eab-4dbdba2f44f8 req-66a84fff-6a89-48d6-bdb9-fcd3adcb12a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:32.323648 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e7af346-9854-4b39-8eab-4dbdba2f44f8 req-66a84fff-6a89-48d6-bdb9-fcd3adcb12a5 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=70ea7b83799640618db2c87847a8ecea&shared=False HTTP/1.1" status: 200 len: 919 time: 0.1033158 Nov 24 11:19:32.677931 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7ebee66e-ee2c-4e42-a5f5-33e56c8d0321 None None] Network 73fc50e3-6c8b-4fe1-bb1e-2972356190e5 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:19:32.752779 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e7af346-9854-4b39-8eab-4dbdba2f44f8 req-1a737d72-5981-43c8-aa4e-62f52216148e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:32.754230 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e7af346-9854-4b39-8eab-4dbdba2f44f8 req-1a737d72-5981-43c8-aa4e-62f52216148e service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.4240618 Nov 24 11:19:32.768989 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-12b1f000-651b-453f-800c-be742604e8fa None None] Provisioning complete for port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:32.769351 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-12b1f000-651b-453f-800c-be742604e8fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:32.777641 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:32.900582 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-7f817b55-6048-4974-bf5c-85f7b04de358 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:32.902072 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-7f817b55-6048-4974-bf5c-85f7b04de358 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 1096 time: 0.0823348 Nov 24 11:19:32.925752 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-12b1f000-651b-453f-800c-be742604e8fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:32.949329 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-928d96bb-e01c-4ed3-bd0a-f525cf59d87e service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922 HTTP/1.1" status: 200 len: 217 time: 0.0382090 Nov 24 11:19:32.968512 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-12b1f000-651b-453f-800c-be742604e8fa None None] For port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65,segment=NetworkSegment(78c61401-1987-4f48-8774-c9e7053eb1b3),segment_id=78c61401-1987-4f48-8774-c9e7053eb1b3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:33.042574 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-80dfa8bb-7bef-4d7d-aa95-e90d9ef800d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:33.046037 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-80dfa8bb-7bef-4d7d-aa95-e90d9ef800d5 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=5eae2e87-935a-45b7-89da-586ce04ad644 HTTP/1.1" status: 200 len: 856 time: 0.0882974 Nov 24 11:19:33.064685 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-12b1f000-651b-453f-800c-be742604e8fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:33.097418 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:19:33.135503 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1009813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-942685'] for router, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:33.138522 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-eb240a83-7038-4d8d-bb4e-e3fdb849328d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:33.140106 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-eb240a83-7038-4d8d-bb4e-e3fdb849328d service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=76fcee22-81e5-4608-a546-3b68c56c5ac7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0654540 Nov 24 11:19:33.161442 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b1f000-651b-453f-800c-be742604e8fa None None] Pushing event updated for resources: {'Port': ['ID=a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:33.173724 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:33.174269 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:33.241902 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-cd6fd9e8-8560-45a1-ab30-912a6147eb14 None None] Provisioning complete for port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:33.242509 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-cd6fd9e8-8560-45a1-ab30-912a6147eb14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:33.288322 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b6433c-5198-408e-9584-3d37d896e192 req-341365eb-33f2-452f-99d2-3d862b988413 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:33.290500 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-31b6433c-5198-408e-9584-3d37d896e192 req-341365eb-33f2-452f-99d2-3d862b988413 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0641193 Nov 24 11:19:33.358173 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-31b6433c-5198-408e-9584-3d37d896e192 req-163e3f48-285d-48f4-bac9-7c0e39f5c0ab tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0571277 Nov 24 11:19:33.358321 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-912274d6-192d-4db3-9203-ae14f355b3f8 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1805007 Nov 24 11:19:33.442090 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Router d7bfdd73-9632-4b35-849e-49f45e824a42 is scheduled to L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 with binding_index 1 {{(pid=103243) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 11:19:33.461198 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-ab6faa6b-614e-4190-9a9c-2bb62204981b req-e44b9433-6ea8-424d-9f30-9786fa68d25c service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0958767 Nov 24 11:19:33.558416 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:19:33.568217 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Sync routers for ids ['d7bfdd73-9632-4b35-849e-49f45e824a42'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:19:33.577485 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Routers {'d7bfdd73-9632-4b35-849e-49f45e824a42'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:33.578186 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['d7bfdd73-9632-4b35-849e-49f45e824a42'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:33.638545 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] Publish callbacks [] for router, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:33.639872 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-e6198ae6-02b8-411f-8648-bd756d9b5259 admin admin] 10.222.0.76 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 3.3495395 Nov 24 11:19:33.642731 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58906) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:33.686250 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Set router d7bfdd73-9632-4b35-849e-49f45e824a42 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:33.878919 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'name': 'tempest-TestShelveInstance-1190328099-router', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:30Z', 'updated_at': '2021-11-24T11:19:32Z', 'revision_number': 3, 'project_id': '02eceba9328941719d32211c28e13ae0', 'gw_port': {'id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 463, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:31Z', 'updated_at': '2021-11-24T11:19:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:33.915647 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Checking router: d7bfdd73-9632-4b35-849e-49f45e824a42 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:19:33.915996 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Updating router d7bfdd73-9632-4b35-849e-49f45e824a42 port a21712de-345b-4141-9d84-af68ebe8dd08 binding host dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:19:34.067603 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.075887 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.240393 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Allocated IP 172.20.0.1 (73fc50e3-6c8b-4fe1-bb1e-2972356190e5/8be715fb-14e8-4c72-8f81-409bf0cdaa60/9f63b074-7e84-49ff-88d1-d86f5c4cb5f1) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:19:34.321874 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Publish callbacks [] for port, precommit_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.343652 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.392084 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.409433 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.449733 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Attempting to bind port a21712de-345b-4141-9d84-af68ebe8dd08 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:19:34.450107 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Attempting to bind port a21712de-345b-4141-9d84-af68ebe8dd08 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:19:34.450476 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Attempting to bind port a21712de-345b-4141-9d84-af68ebe8dd08 on network fa6231d1-a629-42bc-a091-20035dee3542 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:19:34.452635 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7edc5ae2-9472-4cee-8fe9-3fa2aff20bb4 None None] Pushing event updated for resources: {'Port': ['ID=a21712de-345b-4141-9d84-af68ebe8dd08,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:34.455146 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Pushing event updated for resources: {'Port': ['ID=9f63b074-7e84-49ff-88d1-d86f5c4cb5f1,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:34.459069 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 19, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:19:34.459494 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Checking segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:19:34.459894 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.460277 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Bound using segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:19:34.460750 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Bound port: a21712de-345b-4141-9d84-af68ebe8dd08, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:19:34.461519 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.474723 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Network 73fc50e3-6c8b-4fe1-bb1e-2972356190e5 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:19:34.476261 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:34.478579 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:19:34.484084 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dade7e0d-947a-4669-b0e2-efde86f1f1e5 req-84e218cc-3b04-4dc6-af85-86b1ad04d1d1 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:34.486901 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dade7e0d-947a-4669-b0e2-efde86f1f1e5 req-84e218cc-3b04-4dc6-af85-86b1ad04d1d1 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0622356 Nov 24 11:19:34.517427 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] For port a21712de-345b-4141-9d84-af68ebe8dd08, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:19:34.535130 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] For port a21712de-345b-4141-9d84-af68ebe8dd08, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a21712de-345b-4141-9d84-af68ebe8dd08,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:19:34.535416 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1009482'] for router_interface, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.549060 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dade7e0d-947a-4669-b0e2-efde86f1f1e5 req-02d34b47-0b92-4a5d-9fc1-90071db7a609 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0521045 Nov 24 11:19:34.608783 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.671745 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7edc5ae2-9472-4cee-8fe9-3fa2aff20bb4 None None] Pushing event updated for resources: {'Port': ['ID=a21712de-345b-4141-9d84-af68ebe8dd08,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:34.674212 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Routers {'d7bfdd73-9632-4b35-849e-49f45e824a42'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:34.678586 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['d7bfdd73-9632-4b35-849e-49f45e824a42'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:34.724383 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.773670 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-eb33bdf7-ce49-43c0-8742-fba4611dee73 None None] Provisioning complete for port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:34.774226 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-eb33bdf7-ce49-43c0-8742-fba4611dee73 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.820021 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] Set router d7bfdd73-9632-4b35-849e-49f45e824a42 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:34.874679 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-eb33bdf7-ce49-43c0-8742-fba4611dee73 None None] Port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:19:34.895670 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:34.966681 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:35.031657 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'name': 'tempest-TestShelveInstance-1190328099-router', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:30Z', 'updated_at': '2021-11-24T11:19:32Z', 'revision_number': 3, 'project_id': '02eceba9328941719d32211c28e13ae0', 'gw_port': {'id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 463, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:31Z', 'updated_at': '2021-11-24T11:19:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:35.054657 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Pushing event updated for resources: {'Port': ['ID=9f63b074-7e84-49ff-88d1-d86f5c4cb5f1,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:35.067488 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-636370', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1009638'] for router_interface, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:35.072282 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90f3a33c-1925-4c79-b41f-349cf7bd4b76 None None] The sync data for ids ['d7bfdd73-9632-4b35-849e-49f45e824a42'] in dv-cinder-804035-18-iscsi is: [{'id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'name': 'tempest-TestShelveInstance-1190328099-router', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:30Z', 'updated_at': '2021-11-24T11:19:32Z', 'revision_number': 3, 'project_id': '02eceba9328941719d32211c28e13ae0', 'gw_port': {'id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:bc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 463, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:31Z', 'updated_at': '2021-11-24T11:19:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:19:35.073945 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:19:35.132580 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:35.132994 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:35.175408 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Network 73fc50e3-6c8b-4fe1-bb1e-2972356190e5 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:19:35.176869 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:35.326880 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Router d7bfdd73-9632-4b35-849e-49f45e824a42 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:19:35.397829 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99ed14d7-8b44-45c2-98b0-6d15ba385922 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:19:35.457123 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-798ec60e-a194-49f4-baf5-131d1a1fc94a None None] Provisioning complete for port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:35.457599 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-798ec60e-a194-49f4-baf5-131d1a1fc94a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:35.551352 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-798ec60e-a194-49f4-baf5-131d1a1fc94a None None] Port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:19:35.573162 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:35.587920 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'port_id': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'mac_address': 'fa:16:3e:35:03:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1229, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:19:35.635909 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:35.687518 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 99ed14d7-8b44-45c2-98b0-6d15ba385922 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:19:35.740159 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:35.748320 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-205feb74-5fce-44a5-b9ce-b5c5cb22daa7 req-9f1c9991-c92b-4ee2-b610-7cc8fb77a363 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:35.749911 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-205feb74-5fce-44a5-b9ce-b5c5cb22daa7 req-9f1c9991-c92b-4ee2-b610-7cc8fb77a363 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.1023889 Nov 24 11:19:35.794315 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:19:35.797035 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-146b5fa0-a808-43f7-b6e6-64cc80343197 admin admin] 10.222.0.76 "PUT /v2.0/routers/d7bfdd73-9632-4b35-849e-49f45e824a42/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1532605 Nov 24 11:19:35.814562 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:35.843745 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-205feb74-5fce-44a5-b9ce-b5c5cb22daa7 req-0c593e97-cef3-44d2-9336-35a5c20c02ee tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0868006 Nov 24 11:19:35.886240 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=99ed14d7-8b44-45c2-98b0-6d15ba385922,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:36.069548 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['99ed14d7-8b44-45c2-98b0-6d15ba385922'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:19:36.509143 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58940) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:36.513697 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1375630280', 'description': 'tempest-secgroup-smoke-1375630280 description', 'project_id': '89e9b1abd4814b03ae8c95c5918bef03'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:36.597126 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:36.660525 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:36.722222 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:36.750439 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event updated for resources: {'SecurityGroup': ['ID=cfe5fa37-1c99-4d49-a45d-e098df726cee,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:36.758087 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:36.758443 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:36.758781 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:36.759116 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:36.759473 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:36.759813 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:36.760137 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:36.760460 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:36.760785 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:36.761106 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:36.761425 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:36.761742 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:19:36.804662 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:36.808636 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-cf5d71bb-f4dd-4c05-be3f-5bc1e2011d13 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2957165 Nov 24 11:19:36.808799 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58944) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:36.813479 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-bfd54d4a-c80c-419c-a05a-e0ab876208b5 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Request body: {'security_group_rule': {'security_group_id': 'cfe5fa37-1c99-4d49-a45d-e098df726cee', 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:36.900524 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-bfd54d4a-c80c-419c-a05a-e0ab876208b5 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:36.998516 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-bfd54d4a-c80c-419c-a05a-e0ab876208b5 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.008287 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbe72c0a-b49c-4196-a6a1-0f8a2a2f09f1 req-2167d832-e376-41c2-a777-21dbf3217063 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:37.010074 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fbe72c0a-b49c-4196-a6a1-0f8a2a2f09f1 req-2167d832-e376-41c2-a777-21dbf3217063 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 944 time: 0.0801790 Nov 24 11:19:37.063272 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fbe72c0a-b49c-4196-a6a1-0f8a2a2f09f1 req-04017d90-bb06-40b1-bc4c-38ce77e1b0dc tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476818 Nov 24 11:19:37.071167 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-bfd54d4a-c80c-419c-a05a-e0ab876208b5 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.097516 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a21712de-345b-4141-9d84-af68ebe8dd08 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:19:37.098153 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfd54d4a-c80c-419c-a05a-e0ab876208b5 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8419d095-bfd1-460d-a144-047f65b5bd3a,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:37.153533 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port a21712de-345b-4141-9d84-af68ebe8dd08 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:37.153933 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.180346 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-bfd54d4a-c80c-419c-a05a-e0ab876208b5 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.181523 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-bfd54d4a-c80c-419c-a05a-e0ab876208b5 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3716042 Nov 24 11:19:37.184315 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 58954) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:37.188876 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-510c64e8-0bde-472d-9d55-e066f9ad854d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Request body: {'security_group_rule': {'security_group_id': 'cfe5fa37-1c99-4d49-a45d-e098df726cee', 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:37.232688 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.254523 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] For port a21712de-345b-4141-9d84-af68ebe8dd08, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a21712de-345b-4141-9d84-af68ebe8dd08,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:37.280006 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-510c64e8-0bde-472d-9d55-e066f9ad854d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.335855 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-510c64e8-0bde-472d-9d55-e066f9ad854d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.378978 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.406310 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99ed14d7-8b44-45c2-98b0-6d15ba385922 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:19:37.425483 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Sync routers for ids ['d7bfdd73-9632-4b35-849e-49f45e824a42'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:19:37.425965 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-510c64e8-0bde-472d-9d55-e066f9ad854d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.436015 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Routers {'d7bfdd73-9632-4b35-849e-49f45e824a42'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:37.436821 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['d7bfdd73-9632-4b35-849e-49f45e824a42'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:37.448323 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-510c64e8-0bde-472d-9d55-e066f9ad854d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9be18e57-14c0-4faf-a9e6-9e5fd334df1e,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:37.464476 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Pushing event updated for resources: {'Port': ['ID=a21712de-345b-4141-9d84-af68ebe8dd08,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:37.529918 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-510c64e8-0bde-472d-9d55-e066f9ad854d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.531361 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-510c64e8-0bde-472d-9d55-e066f9ad854d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3458321 Nov 24 11:19:37.534164 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58956) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:37.538777 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-8ec4c85d-6329-4147-8a37-1b6e54ba60c1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Request body: {'security_group_rule': {'security_group_id': 'cfe5fa37-1c99-4d49-a45d-e098df726cee', 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:37.544834 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Set router d7bfdd73-9632-4b35-849e-49f45e824a42 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:37.573481 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 99ed14d7-8b44-45c2-98b0-6d15ba385922 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:19:37.577421 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 99ed14d7-8b44-45c2-98b0-6d15ba385922 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:37.577789 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.652113 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ec4c85d-6329-4147-8a37-1b6e54ba60c1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.656269 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.680238 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:19:37.682402 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-18399425-fe6a-402a-ac7e-dafa27fbec6f" -d '{"events": [{"server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "name": "network-vif-plugged", "status": "completed", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:19:37.696605 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:37.714885 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ec4c85d-6329-4147-8a37-1b6e54ba60c1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.731009 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:19:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-80ef9f2c-fe98-4392-9bd8-0b052cba8f83 x-openstack-request-id: req-80ef9f2c-fe98-4392-9bd8-0b052cba8f83 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:19:37.731009 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "name": "network-vif-plugged", "status": "completed", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:19:37.731009 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-80ef9f2c-fe98-4392-9bd8-0b052cba8f83 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:19:37.731009 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'code': 200} Nov 24 11:19:37.757276 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'name': 'tempest-TestShelveInstance-1190328099-router', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:30Z', 'updated_at': '2021-11-24T11:19:34Z', 'revision_number': 4, 'project_id': '02eceba9328941719d32211c28e13ae0', 'gw_port': {'id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 463, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:31Z', 'updated_at': '2021-11-24T11:19:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '9f63b074-7e84-49ff-88d1-d86f5c4cb5f1', 'name': '', 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'mac_address': 'fa:16:3e:71:47:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'device_owner': 'network:router_interface', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '8be715fb-14e8-4c72-8f81-409bf0cdaa60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:34Z', 'updated_at': '2021-11-24T11:19:34Z', 'revision_number': 2, 'project_id': '02eceba9328941719d32211c28e13ae0', 'subnets': [{'id': '8be715fb-14e8-4c72-8f81-409bf0cdaa60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:37.779767 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.790348 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Checking router: d7bfdd73-9632-4b35-849e-49f45e824a42 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:19:37.790712 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Updating router d7bfdd73-9632-4b35-849e-49f45e824a42 port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 binding host dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:19:37.790833 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ec4c85d-6329-4147-8a37-1b6e54ba60c1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.806814 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ec4c85d-6329-4147-8a37-1b6e54ba60c1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d87a6af0-c4d1-42e4-a372-9500d2fc090a,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:37.820348 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.839018 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=99ed14d7-8b44-45c2-98b0-6d15ba385922,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:37.907388 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ec4c85d-6329-4147-8a37-1b6e54ba60c1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:37.908725 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-8ec4c85d-6329-4147-8a37-1b6e54ba60c1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3734426 Nov 24 11:19:37.911686 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58960) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:37.915998 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-185b796d-b2e2-4c0b-a161-592626f1e413 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Request body: {'security_group_rule': {'security_group_id': 'cfe5fa37-1c99-4d49-a45d-e098df726cee', 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:38.048016 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-029d62e9-c25d-46c8-8b06-c16327ae5005 req-9535b27e-e58c-42c3-9f3d-48206d349b25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:38.050186 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-029d62e9-c25d-46c8-8b06-c16327ae5005 req-9535b27e-e58c-42c3-9f3d-48206d349b25 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 1098 time: 0.0430522 Nov 24 11:19:38.053286 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-185b796d-b2e2-4c0b-a161-592626f1e413 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.088464 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Publish callbacks [] for port, precommit_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.139865 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-029d62e9-c25d-46c8-8b06-c16327ae5005 req-c4fe28b8-80b4-471d-962e-fd391ec158cd service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0772479 Nov 24 11:19:38.152281 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-185b796d-b2e2-4c0b-a161-592626f1e413 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.158783 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.198331 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7487eeb-983f-4ae6-bf44-d4d84d0929ff req-e2694dbf-f3c6-450a-b8a6-fbe858369645 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:38.199960 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e7487eeb-983f-4ae6-bf44-d4d84d0929ff req-e2694dbf-f3c6-450a-b8a6-fbe858369645 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0591555 Nov 24 11:19:38.205028 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc635d65-8a70-42e7-a23d-9c74951e0326 None None] Pushing event updated for resources: {'Port': ['ID=9f63b074-7e84-49ff-88d1-d86f5c4cb5f1,revision_number=3']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:38.275661 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Attempting to bind port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:19:38.276031 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Attempting to bind port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': '78c61401-1987-4f48-8774-c9e7053eb1b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1212, 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5'}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:19:38.276389 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Attempting to bind port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 on network 73fc50e3-6c8b-4fe1-bb1e-2972356190e5 {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:19:38.281816 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 19, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:19:38.282238 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Checking segment: {'id': '78c61401-1987-4f48-8774-c9e7053eb1b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1212, 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:19:38.285808 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-185b796d-b2e2-4c0b-a161-592626f1e413 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.286061 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.286061 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Bound using segment: {'id': '78c61401-1987-4f48-8774-c9e7053eb1b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1212, 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5'} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:19:38.286061 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Bound port: 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '78c61401-1987-4f48-8774-c9e7053eb1b3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1212, 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5'}}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:19:38.286061 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.294038 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e7487eeb-983f-4ae6-bf44-d4d84d0929ff req-9eadf2b6-4cf5-4767-acb5-98f95e852901 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0807226 Nov 24 11:19:38.306760 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-185b796d-b2e2-4c0b-a161-592626f1e413 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=410b88d8-d846-46b2-897e-711ce5ec49cd,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:38.366169 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] For port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:19:38.369265 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] For port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9f63b074-7e84-49ff-88d1-d86f5c4cb5f1,segment=NetworkSegment(78c61401-1987-4f48-8774-c9e7053eb1b3),segment_id=78c61401-1987-4f48-8774-c9e7053eb1b3)] {{(pid=103246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:19:38.414292 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-185b796d-b2e2-4c0b-a161-592626f1e413 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.415537 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-185b796d-b2e2-4c0b-a161-592626f1e413 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5029011 Nov 24 11:19:38.418409 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58974) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:38.435037 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-49a4b1f4-93a3-4adc-90c8-533e896ac332 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Request body: {'security_group_rule': {'security_group_id': 'cfe5fa37-1c99-4d49-a45d-e098df726cee', 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:38.459834 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.508396 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-c5a28d91-e522-41ea-b5d2-141833dd7542 None None] Provisioning complete for port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:38.508975 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c5a28d91-e522-41ea-b5d2-141833dd7542 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.519529 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc635d65-8a70-42e7-a23d-9c74951e0326 None None] Pushing event updated for resources: {'Port': ['ID=9f63b074-7e84-49ff-88d1-d86f5c4cb5f1,revision_number=4']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:38.524029 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.securitygroups_db [None req-49a4b1f4-93a3-4adc-90c8-533e896ac332 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Project 89e9b1abd4814b03ae8c95c5918bef03 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 11:19:38.534963 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Routers {'d7bfdd73-9632-4b35-849e-49f45e824a42'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:38.534963 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['d7bfdd73-9632-4b35-849e-49f45e824a42'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:38.536453 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49a4b1f4-93a3-4adc-90c8-533e896ac332 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.608573 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c5a28d91-e522-41ea-b5d2-141833dd7542 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.618404 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49a4b1f4-93a3-4adc-90c8-533e896ac332 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.634806 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] Set router d7bfdd73-9632-4b35-849e-49f45e824a42 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:38.645220 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-c5a28d91-e522-41ea-b5d2-141833dd7542 None None] For port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9f63b074-7e84-49ff-88d1-d86f5c4cb5f1,segment=NetworkSegment(78c61401-1987-4f48-8774-c9e7053eb1b3),segment_id=78c61401-1987-4f48-8774-c9e7053eb1b3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:38.706094 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49a4b1f4-93a3-4adc-90c8-533e896ac332 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.724594 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49a4b1f4-93a3-4adc-90c8-533e896ac332 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a325c128-c405-4f82-b21d-7277c61cb0fb,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:38.732626 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c5a28d91-e522-41ea-b5d2-141833dd7542 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.734308 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5e7ad9c9-e023-40b3-9620-59a0c294cabc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.788404 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5a28d91-e522-41ea-b5d2-141833dd7542 None None] Pushing event updated for resources: {'Port': ['ID=9f63b074-7e84-49ff-88d1-d86f5c4cb5f1,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:38.821969 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49a4b1f4-93a3-4adc-90c8-533e896ac332 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.824690 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-49a4b1f4-93a3-4adc-90c8-533e896ac332 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4053953 Nov 24 11:19:38.827433 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 58978) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:38.832394 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-0243c7db-7892-498b-9c89-9771af981190 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Request body: {'security_group_rule': {'security_group_id': 'cfe5fa37-1c99-4d49-a45d-e098df726cee', 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:38.849294 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'name': 'tempest-TestShelveInstance-1190328099-router', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:30Z', 'updated_at': '2021-11-24T11:19:34Z', 'revision_number': 4, 'project_id': '02eceba9328941719d32211c28e13ae0', 'gw_port': {'id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 463, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:31Z', 'updated_at': '2021-11-24T11:19:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '9f63b074-7e84-49ff-88d1-d86f5c4cb5f1', 'name': '', 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'mac_address': 'fa:16:3e:71:47:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'device_owner': 'network:router_interface', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '8be715fb-14e8-4c72-8f81-409bf0cdaa60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:34Z', 'updated_at': '2021-11-24T11:19:38Z', 'revision_number': 4, 'project_id': '02eceba9328941719d32211c28e13ae0', 'subnets': [{'id': '8be715fb-14e8-4c72-8f81-409bf0cdaa60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:38.852458 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-b2cd7a59-790a-40b7-aa48-61b91b8e4595 None None] Provisioning complete for port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:38.852824 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b2cd7a59-790a-40b7-aa48-61b91b8e4595 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:38.880570 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5d2f8512-5d63-4b4d-b00a-fb067fea2b7d None None] The sync data for ids ['d7bfdd73-9632-4b35-849e-49f45e824a42'] in dv-cinder-804035-18-iscsi is: [{'id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'name': 'tempest-TestShelveInstance-1190328099-router', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:30Z', 'updated_at': '2021-11-24T11:19:34Z', 'revision_number': 4, 'project_id': '02eceba9328941719d32211c28e13ae0', 'gw_port': {'id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 463, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:31Z', 'updated_at': '2021-11-24T11:19:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '9f63b074-7e84-49ff-88d1-d86f5c4cb5f1', 'name': '', 'network_id': '73fc50e3-6c8b-4fe1-bb1e-2972356190e5', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'mac_address': 'fa:16:3e:71:47:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'device_owner': 'network:router_interface', 'standard_attr_id': 464, 'fixed_ips': [{'subnet_id': '8be715fb-14e8-4c72-8f81-409bf0cdaa60', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:34Z', 'updated_at': '2021-11-24T11:19:38Z', 'revision_number': 4, 'project_id': '02eceba9328941719d32211c28e13ae0', 'subnets': [{'id': '8be715fb-14e8-4c72-8f81-409bf0cdaa60', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:19:38.933586 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.securitygroups_db [None req-0243c7db-7892-498b-9c89-9771af981190 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Project 89e9b1abd4814b03ae8c95c5918bef03 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 11:19:38.946057 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0243c7db-7892-498b-9c89-9771af981190 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:39.027995 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0243c7db-7892-498b-9c89-9771af981190 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:39.099815 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0243c7db-7892-498b-9c89-9771af981190 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:39.121788 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0243c7db-7892-498b-9c89-9771af981190 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3528f186-c9e8-47c4-af27-8591418b56f6,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:39.158525 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a21712de-345b-4141-9d84-af68ebe8dd08 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:19:39.194649 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:39.213365 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port a21712de-345b-4141-9d84-af68ebe8dd08 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:39.213731 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:39.250468 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-0243c7db-7892-498b-9c89-9771af981190 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:39.252172 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-0243c7db-7892-498b-9c89-9771af981190 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4237697 Nov 24 11:19:39.451276 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab490f28-510b-46f9-8637-06e47b14e4e4 req-cb6c3066-939e-4c56-a153-7e283f989ef5 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:39.452285 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:19:39.453654 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ab490f28-510b-46f9-8637-06e47b14e4e4 req-cb6c3066-939e-4c56-a153-7e283f989ef5 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0684779 Nov 24 11:19:39.597333 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:39.597333 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:39.598848 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ab490f28-510b-46f9-8637-06e47b14e4e4 req-4daff962-70ea-4637-9452-5903f1c06b05 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0838659 Nov 24 11:19:40.705212 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cf9ff22-ed97-46be-944e-551cc8bac040 req-c0a3b090-2c4d-431b-9d8e-a92571f3db8d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:40.707776 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0cf9ff22-ed97-46be-944e-551cc8bac040 req-c0a3b090-2c4d-431b-9d8e-a92571f3db8d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0499525 Nov 24 11:19:40.755918 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0cf9ff22-ed97-46be-944e-551cc8bac040 req-a62a644c-bd16-4e76-be1c-605a86e9523c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422287 Nov 24 11:19:40.880781 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a2f3d0c-93f0-4619-aaa9-51ce1bf64ac3 req-e0537e57-5da3-4dfb-983d-5ab3ff9a04f7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:40.882250 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1a2f3d0c-93f0-4619-aaa9-51ce1bf64ac3 req-e0537e57-5da3-4dfb-983d-5ab3ff9a04f7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0546920 Nov 24 11:19:40.890912 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59060) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:40.895234 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-12fbccb5-7660-4887-9068-25a84a177a80 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Request body: {'floatingip': {'port_id': '99ed14d7-8b44-45c2-98b0-6d15ba385922'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:40.934161 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-12fbccb5-7660-4887-9068-25a84a177a80 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:41.145685 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b2a1d312-865e-4872-8f20-8a1ca36dba73 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:41.409725 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-12fbccb5-7660-4887-9068-25a84a177a80 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:41.482193 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-12fbccb5-7660-4887-9068-25a84a177a80 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:41.589483 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.l3_db [None req-12fbccb5-7660-4887-9068-25a84a177a80 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Floating IP 77db85ba-8d04-452a-929c-9c9b8c4880a6 associated. External IP: 172.27.3.74, port: 99ed14d7-8b44-45c2-98b0-6d15ba385922. Nov 24 11:19:41.803956 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-12fbccb5-7660-4887-9068-25a84a177a80 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Router 7bb4df85-5735-4ea8-9136-d2387a677310 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:19:41.912976 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-12fbccb5-7660-4887-9068-25a84a177a80 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:19:41.917653 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-12fbccb5-7660-4887-9068-25a84a177a80 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:41.923066 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edb46e13-00a8-426e-99e0-8381a5b1a1d9 None None] Sync routers for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:19:41.933426 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edb46e13-00a8-426e-99e0-8381a5b1a1d9 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:41.934113 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-edb46e13-00a8-426e-99e0-8381a5b1a1d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:41.948451 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-12fbccb5-7660-4887-9068-25a84a177a80 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "PUT /v2.0/floatingips/77db85ba-8d04-452a-929c-9c9b8c4880a6 HTTP/1.1" status: 200 len: 990 time: 1.0564802 Nov 24 11:19:41.949152 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:19:41.951523 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b135206-461d-4f34-adcf-8e9641821d95" -d '{"events": [{"name": "network-changed", "server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:19:41.991447 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:19:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-287fb832-3068-43c6-94b7-254edd0e95da x-openstack-request-id: req-287fb832-3068-43c6-94b7-254edd0e95da {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:19:41.991743 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:19:41.992000 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-287fb832-3068-43c6-94b7-254edd0e95da {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:19:41.992398 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'status': 'completed', 'code': 200} Nov 24 11:19:42.052495 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-edb46e13-00a8-426e-99e0-8381a5b1a1d9 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:42.064584 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b135206-461d-4f34-adcf-8e9641821d95 req-08582559-514f-4a11-a8eb-1752d55b0d13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:42.067040 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-6b135206-461d-4f34-adcf-8e9641821d95 req-08582559-514f-4a11-a8eb-1752d55b0d13 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 1098 time: 0.0488842 Nov 24 11:19:42.164223 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b135206-461d-4f34-adcf-8e9641821d95 req-fe82efdb-43ab-4ab1-9bc3-a60b9ee21dfe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:42.165676 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-6b135206-461d-4f34-adcf-8e9641821d95 req-fe82efdb-43ab-4ab1-9bc3-a60b9ee21dfe service neutron] 10.222.0.86 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 919 time: 0.0898254 Nov 24 11:19:42.238327 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-6b135206-461d-4f34-adcf-8e9641821d95 req-49ec9f9c-6435-43cb-ab1d-edfbd11ea504 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922 HTTP/1.1" status: 200 len: 998 time: 0.0648730 Nov 24 11:19:42.292498 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-edb46e13-00a8-426e-99e0-8381a5b1a1d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '77db85ba-8d04-452a-929c-9c9b8c4880a6', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'floating_ip_address': '172.27.3.74', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'port_id': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 450, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'mac_address': 'fa:16:3e:35:03:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:19:24Z', 'updated_at': '2021-11-24T11:19:41Z', 'revision_number': 1, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:42.293141 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b135206-461d-4f34-adcf-8e9641821d95 req-b4b28656-ccda-4afb-9301-490a7b65df6d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:42.294269 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-6b135206-461d-4f34-adcf-8e9641821d95 req-b4b28656-ccda-4afb-9301-490a7b65df6d service neutron] 10.222.0.86 "GET /v2.0/subnets?id=5eae2e87-935a-45b7-89da-586ce04ad644 HTTP/1.1" status: 200 len: 856 time: 0.0486300 Nov 24 11:19:42.323384 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edb46e13-00a8-426e-99e0-8381a5b1a1d9 None None] Checking router: 7bb4df85-5735-4ea8-9136-d2387a677310 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:19:42.332370 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edb46e13-00a8-426e-99e0-8381a5b1a1d9 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:42.333025 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-edb46e13-00a8-426e-99e0-8381a5b1a1d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:42.355839 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b135206-461d-4f34-adcf-8e9641821d95 req-a9da0889-3ad3-4b80-8ee5-c3b85a608bab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:42.357633 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-6b135206-461d-4f34-adcf-8e9641821d95 req-a9da0889-3ad3-4b80-8ee5-c3b85a608bab service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=76fcee22-81e5-4608-a546-3b68c56c5ac7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0547724 Nov 24 11:19:42.468251 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:42.473595 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-edb46e13-00a8-426e-99e0-8381a5b1a1d9 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:42.483116 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-6b135206-461d-4f34-adcf-8e9641821d95 req-7946c5cd-35ea-4fac-9e31-a88c9ecef325 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1162972 Nov 24 11:19:42.589733 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-6b135206-461d-4f34-adcf-8e9641821d95 req-a38011e0-a4ae-4e52-b8be-3a7f53e74204 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0975296 Nov 24 11:19:42.743451 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-edb46e13-00a8-426e-99e0-8381a5b1a1d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '77db85ba-8d04-452a-929c-9c9b8c4880a6', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'floating_ip_address': '172.27.3.74', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'port_id': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 450, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'mac_address': 'fa:16:3e:35:03:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:19:24Z', 'updated_at': '2021-11-24T11:19:41Z', 'revision_number': 1, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:42.774919 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edb46e13-00a8-426e-99e0-8381a5b1a1d9 None None] The sync data for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi is: [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '77db85ba-8d04-452a-929c-9c9b8c4880a6', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'floating_ip_address': '172.27.3.74', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'port_id': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 450, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'mac_address': 'fa:16:3e:35:03:31', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:19:24Z', 'updated_at': '2021-11-24T11:19:41Z', 'revision_number': 1, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:19:43.107744 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f3063db8-2166-403d-9e81-2c78edd3925d None None] New status for floating IP 77db85ba-8d04-452a-929c-9c9b8c4880a6: ACTIVE {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:19:43.315352 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 59108) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:43.440471 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-88774d75-5143-4a06-8455-14daff7e506b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:43.516955 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1de9b6e-21ac-4d8d-9098-d7399d410ad6 req-4e05c326-9b15-4e67-8902-9b852570f713 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:43.519745 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f1de9b6e-21ac-4d8d-9098-d7399d410ad6 req-4e05c326-9b15-4e67-8902-9b852570f713 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0554006 Nov 24 11:19:43.531655 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-88774d75-5143-4a06-8455-14daff7e506b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:43.567836 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f1de9b6e-21ac-4d8d-9098-d7399d410ad6 req-aa22411e-3c77-46b8-a521-cd1db12afd59 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432699 Nov 24 11:19:43.619722 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-88774d75-5143-4a06-8455-14daff7e506b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:43.661109 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-88774d75-5143-4a06-8455-14daff7e506b admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=97065abe0afd466ca1110a02a2bed231&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3418429 Nov 24 11:19:43.661109 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88774d75-5143-4a06-8455-14daff7e506b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c160fb2-80fa-4864-9290-8894f07be170,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:43.661446 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59116) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:43.710792 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-736f97b3-eb27-4e68-88bb-4a1afb20228e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:43.732546 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-736f97b3-eb27-4e68-88bb-4a1afb20228e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:43.871175 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-736f97b3-eb27-4e68-88bb-4a1afb20228e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:43.873729 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-736f97b3-eb27-4e68-88bb-4a1afb20228e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:43.874898 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-736f97b3-eb27-4e68-88bb-4a1afb20228e admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/4c160fb2-80fa-4864-9290-8894f07be170 HTTP/1.1" status: 204 len: 168 time: 0.2124898 Nov 24 11:19:43.883478 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-736f97b3-eb27-4e68-88bb-4a1afb20228e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c160fb2-80fa-4864-9290-8894f07be170,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:44.053767 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:44.584823 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59126) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:44.598682 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8fc5e059-3669-4cd0-af95-b4e2ad1b0768 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:44.718544 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffdff39f-d967-428e-b4b3-5ae6d22e53d3 req-cb3199b0-2fba-421c-96ea-c6183a7ee348 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:44.720020 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ffdff39f-d967-428e-b4b3-5ae6d22e53d3 req-cb3199b0-2fba-421c-96ea-c6183a7ee348 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0802352 Nov 24 11:19:44.725059 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8fc5e059-3669-4cd0-af95-b4e2ad1b0768 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:44.770384 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ffdff39f-d967-428e-b4b3-5ae6d22e53d3 req-7b64bc05-accd-441e-9090-3c06e633003f tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439789 Nov 24 11:19:44.771537 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8fc5e059-3669-4cd0-af95-b4e2ad1b0768 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:44.785346 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:44.810589 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fc5e059-3669-4cd0-af95-b4e2ad1b0768 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=24f05b37-b4fb-4963-ac18-d8dd6814e23e,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:44.814829 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-8fc5e059-3669-4cd0-af95-b4e2ad1b0768 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=460505fa068949518b7e336137cece9c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2289588 Nov 24 11:19:44.817975 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59130) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:44.873437 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-da8b344c-c6ea-4811-b2e4-9ce976c70cc9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:44.894668 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-da8b344c-c6ea-4811-b2e4-9ce976c70cc9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:44.991132 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-da8b344c-c6ea-4811-b2e4-9ce976c70cc9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:44.993670 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-da8b344c-c6ea-4811-b2e4-9ce976c70cc9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:44.994847 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-da8b344c-c6ea-4811-b2e4-9ce976c70cc9 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/24f05b37-b4fb-4963-ac18-d8dd6814e23e HTTP/1.1" status: 204 len: 168 time: 0.1759615 Nov 24 11:19:45.004227 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da8b344c-c6ea-4811-b2e4-9ce976c70cc9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=24f05b37-b4fb-4963-ac18-d8dd6814e23e,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:45.758212 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69d8353a-8a81-43f9-9415-595405536b73 req-828a90bc-0744-462f-9b85-16063c198db0 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:45.759877 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-69d8353a-8a81-43f9-9415-595405536b73 req-828a90bc-0744-462f-9b85-16063c198db0 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.86 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0502317 Nov 24 11:19:45.863812 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Deleting port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:19:45.865022 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:45.920781 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c057786-e5f3-4fff-a84a-34327191d8b6 req-6c725b39-5c1a-430e-8c5d-e49db1ae0afa tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:45.922407 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1c057786-e5f3-4fff-a84a-34327191d8b6 req-6c725b39-5c1a-430e-8c5d-e49db1ae0afa tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 945 time: 0.0541866 Nov 24 11:19:45.963821 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] For port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:45.964186 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:45.973087 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1c057786-e5f3-4fff-a84a-34327191d8b6 req-109fc14f-5e7f-4120-abce-5ed21fcfc178 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=4d84d439-4e42-43d6-9a84-d7924912abec&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439277 Nov 24 11:19:46.147961 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:46.148318 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:46.148640 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.l3_db [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Floating IP 3e91da78-5ead-425c-9124-df269603b837 disassociated. External IP: 172.27.3.245, port: dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa. Nov 24 11:19:46.148970 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Calling delete_port for dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:19:46.373765 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:46.404847 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event deleted for resources: {'Port': ['ID=dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:46.519352 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:19:46.634331 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:19:46.644997 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-345e75f3-9634-43ce-97d3-8bbdcba6dfcd None None] Sync routers for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:19:46.656559 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-345e75f3-9634-43ce-97d3-8bbdcba6dfcd None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:46.657260 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-345e75f3-9634-43ce-97d3-8bbdcba6dfcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:46.674734 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] No DVR routers for this DVR port dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:19:46.677879 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:46.681401 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-69d8353a-8a81-43f9-9415-595405536b73 req-5d80a443-d23a-4c51-bc08-515c5f1dbc4b tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.86 "DELETE /v2.0/ports/dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa HTTP/1.1" status: 204 len: 173 time: 0.9092848 Nov 24 11:19:46.681857 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'name': 'network-vif-deleted', 'tag': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:19:46.684609 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da977c8d-e798-4ec3-9bba-0c621494ea12" -d '{"events": [{"server_uuid": "91407c11-277d-4df0-83b5-cbb8696fb8c2", "name": "network-vif-deleted", "tag": "dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:19:46.723688 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:19:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-43adae33-9a49-4cdf-a067-ccc3117dd0dd x-openstack-request-id: req-43adae33-9a49-4cdf-a067-ccc3117dd0dd {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:19:46.724192 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "91407c11-277d-4df0-83b5-cbb8696fb8c2", "name": "network-vif-deleted", "tag": "dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:19:46.724800 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-43adae33-9a49-4cdf-a067-ccc3117dd0dd {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:19:46.725501 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '91407c11-277d-4df0-83b5-cbb8696fb8c2', 'name': 'network-vif-deleted', 'tag': 'dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa', 'status': 'completed', 'code': 200} Nov 24 11:19:46.778009 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-345e75f3-9634-43ce-97d3-8bbdcba6dfcd None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:47.010071 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-345e75f3-9634-43ce-97d3-8bbdcba6dfcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:11Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:47.039124 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-345e75f3-9634-43ce-97d3-8bbdcba6dfcd None None] Checking router: 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:19:47.050933 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-345e75f3-9634-43ce-97d3-8bbdcba6dfcd None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:19:47.052386 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-345e75f3-9634-43ce-97d3-8bbdcba6dfcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:47.128421 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dd059276-2e79-4ba8-bac5-68eb63c106c9 req-819d7135-46c1-4099-aa76-0ee3de1f271a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=91407c11-277d-4df0-83b5-cbb8696fb8c2 HTTP/1.1" status: 200 len: 210 time: 0.0276515 Nov 24 11:19:47.165564 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-345e75f3-9634-43ce-97d3-8bbdcba6dfcd None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:19:47.367535 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-345e75f3-9634-43ce-97d3-8bbdcba6dfcd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:11Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:19:47.397847 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-345e75f3-9634-43ce-97d3-8bbdcba6dfcd None None] The sync data for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi is: [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:11Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:19:47.671752 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a72460df-3122-49ec-971c-0d82f789d33c None None] New status for floating IP 3e91da78-5ead-425c-9124-df269603b837: DOWN {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:19:48.283447 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59216) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:48.345182 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dfd6756a-ad56-492b-b310-1d061b8a2320 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:48.369359 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dfd6756a-ad56-492b-b310-1d061b8a2320 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:48.493240 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dfd6756a-ad56-492b-b310-1d061b8a2320 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:48.496751 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dfd6756a-ad56-492b-b310-1d061b8a2320 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:48.497726 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-dfd6756a-ad56-492b-b310-1d061b8a2320 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "DELETE /v2.0/security-groups/4d84d439-4e42-43d6-9a84-d7924912abec HTTP/1.1" status: 204 len: 168 time: 0.2132063 Nov 24 11:19:48.499905 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 59226) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:48.508382 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfd6756a-ad56-492b-b310-1d061b8a2320 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d84d439-4e42-43d6-9a84-d7924912abec,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:48.516206 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.api.v2.resource [None req-d1dfd831-d791-4d3b-8351-b6aa18783ed9 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] show failed (client error): The resource could not be found. Nov 24 11:19:48.517356 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-d1dfd831-d791-4d3b-8351-b6aa18783ed9 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups/4d84d439-4e42-43d6-9a84-d7924912abec HTTP/1.1" status: 404 len: 347 time: 0.0163412 Nov 24 11:19:48.520099 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 59230) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:48.662910 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-ff6f1a06-4117-4443-969b-b724087221e5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Deleting port 50a2e02a-dcf5-4d48-b73e-07210118997a {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:19:48.663200 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ff6f1a06-4117-4443-969b-b724087221e5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:48.747743 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ff6f1a06-4117-4443-969b-b724087221e5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:48.748064 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ff6f1a06-4117-4443-969b-b724087221e5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:48.760197 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-ff6f1a06-4117-4443-969b-b724087221e5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Calling delete_port for 50a2e02a-dcf5-4d48-b73e-07210118997a owned by network:floatingip {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:19:49.020913 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ff6f1a06-4117-4443-969b-b724087221e5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:49.050096 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff6f1a06-4117-4443-969b-b724087221e5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event deleted for resources: {'Port': ['ID=50a2e02a-dcf5-4d48-b73e-07210118997a,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:49.116944 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ff6f1a06-4117-4443-969b-b724087221e5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:49.119778 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ff6f1a06-4117-4443-969b-b724087221e5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:49.127822 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-ff6f1a06-4117-4443-969b-b724087221e5 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "DELETE /v2.0/floatingips/3e91da78-5ead-425c-9124-df269603b837 HTTP/1.1" status: 204 len: 168 time: 0.5996432 Nov 24 11:19:49.514820 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:19:49.524595 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 59278) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:49.529062 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-d269ab23-35eb-463a-a38e-ca8847a3b2f8 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Request body: {'security_group': {'name': 'tempest-securitygroup--207604155', 'description': 'tempest-description--1324640477'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:49.535210 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:19:49.536596 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device dd29fb3e-7f5a-4d9b-9803-c9ff4a11e2aa not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:19:49.614628 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d269ab23-35eb-463a-a38e-ca8847a3b2f8 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:49.681679 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d269ab23-35eb-463a-a38e-ca8847a3b2f8 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:49.750611 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d269ab23-35eb-463a-a38e-ca8847a3b2f8 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:49.780769 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d269ab23-35eb-463a-a38e-ca8847a3b2f8 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event updated for resources: {'SecurityGroup': ['ID=bb1075fc-6aff-413d-aede-b8cd5b582753,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:49.844321 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d269ab23-35eb-463a-a38e-ca8847a3b2f8 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:49.845471 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-d269ab23-35eb-463a-a38e-ca8847a3b2f8 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.3198767 Nov 24 11:19:49.853161 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 59296) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:49.857899 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-a0d37988-e43c-4f1f-b07e-9420ba54fcb1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Request body: {'security_group_rule': {'security_group_id': 'bb1075fc-6aff-413d-aede-b8cd5b582753', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:49.988465 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a0d37988-e43c-4f1f-b07e-9420ba54fcb1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.051009 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a0d37988-e43c-4f1f-b07e-9420ba54fcb1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.127957 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a0d37988-e43c-4f1f-b07e-9420ba54fcb1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.147152 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0d37988-e43c-4f1f-b07e-9420ba54fcb1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=50745237-2360-434f-bb1a-859b75e3192b,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:50.215952 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a0d37988-e43c-4f1f-b07e-9420ba54fcb1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.217176 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-a0d37988-e43c-4f1f-b07e-9420ba54fcb1 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3628924 Nov 24 11:19:50.219825 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 59302) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:50.224301 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-8bb4c1fc-f2c5-4d87-8205-857d0e9ef629 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Request body: {'security_group_rule': {'security_group_id': 'bb1075fc-6aff-413d-aede-b8cd5b582753', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:50.340086 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8bb4c1fc-f2c5-4d87-8205-857d0e9ef629 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.399970 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8bb4c1fc-f2c5-4d87-8205-857d0e9ef629 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.451441 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 59306) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:50.488086 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8bb4c1fc-f2c5-4d87-8205-857d0e9ef629 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.507610 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bb4c1fc-f2c5-4d87-8205-857d0e9ef629 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=76fb64e7-3802-445c-b3b5-61fc1627f434,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:50.558612 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3e2677fb-2f02-4f32-8bf9-6e95e524e41c admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.600116 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8bb4c1fc-f2c5-4d87-8205-857d0e9ef629 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.601303 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-8bb4c1fc-f2c5-4d87-8205-857d0e9ef629 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3805370 Nov 24 11:19:50.604542 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59310) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:50.609045 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Request body: {'floatingip': {'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:50.640642 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3e2677fb-2f02-4f32-8bf9-6e95e524e41c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.716495 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.743478 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3e2677fb-2f02-4f32-8bf9-6e95e524e41c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.783811 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-3e2677fb-2f02-4f32-8bf9-6e95e524e41c admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=fb1b2c5b311b4af5b1d0822e26086009&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3312325 Nov 24 11:19:50.784414 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 59316) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:50.799942 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e2677fb-2f02-4f32-8bf9-6e95e524e41c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1e26a78-40f3-4c31-a810-1e76626263dd,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:50.830455 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.845568 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f47fc659-86a3-48c3-be71-abf467201014 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.867580 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f47fc659-86a3-48c3-be71-abf467201014 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.939939 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Allocated IP 172.27.3.50 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/376f8f31-41d7-4cda-9de3-269d9e4dac82) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:19:50.990841 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f47fc659-86a3-48c3-be71-abf467201014 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.993460 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f47fc659-86a3-48c3-be71-abf467201014 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:50.994596 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-f47fc659-86a3-48c3-be71-abf467201014 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/d1e26a78-40f3-4c31-a810-1e76626263dd HTTP/1.1" status: 204 len: 168 time: 0.2060244 Nov 24 11:19:51.003021 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f47fc659-86a3-48c3-be71-abf467201014 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1e26a78-40f3-4c31-a810-1e76626263dd,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:51.054090 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:51.178799 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:51.221143 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:19:51.223870 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:51.228188 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:19:51.231127 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event updated for resources: {'Port': ['ID=376f8f31-41d7-4cda-9de3-269d9e4dac82,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:51.317247 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:51.420653 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:51.570555 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for port, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:51.601027 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 59322) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:51.615798 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4c6e5143-f71e-4e0f-9ca5-ab4615174455 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:51.630944 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8699083'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:51.693793 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4c6e5143-f71e-4e0f-9ca5-ab4615174455 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:51.703045 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event updated for resources: {'Port': ['ID=376f8f31-41d7-4cda-9de3-269d9e4dac82,revision_number=2']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:51.713274 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:51.796680 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4c6e5143-f71e-4e0f-9ca5-ab4615174455 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:51.827494 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:51.829011 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2ac0cc23-eee2-4fc5-9800-c459d492aa91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.2233202 Nov 24 11:19:51.841324 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-4c6e5143-f71e-4e0f-9ca5-ab4615174455 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=ae232e0e5af24ab08093f49f810c4d31&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2392182 Nov 24 11:19:51.842435 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c6e5143-f71e-4e0f-9ca5-ab4615174455 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=effccb5d-53b5-4535-8943-9ed5791ef8f3,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:51.847634 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59328) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:51.905114 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-137e6d84-9f51-4961-8b71-58fe8e986310 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:51.927724 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-137e6d84-9f51-4961-8b71-58fe8e986310 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:52.046282 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-137e6d84-9f51-4961-8b71-58fe8e986310 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:52.049002 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-137e6d84-9f51-4961-8b71-58fe8e986310 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:52.050153 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-137e6d84-9f51-4961-8b71-58fe8e986310 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/effccb5d-53b5-4535-8943-9ed5791ef8f3 HTTP/1.1" status: 204 len: 168 time: 0.2015195 Nov 24 11:19:52.058628 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-4bae683e-8f37-4e0c-a651-45e4a6d07f24 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?name=tempest-securitygroup--207604155&fields=id&tenant_id=907128185ff9473381be53050d202838 HTTP/1.1" status: 200 len: 267 time: 0.0534179 Nov 24 11:19:52.063515 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-137e6d84-9f51-4961-8b71-58fe8e986310 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=effccb5d-53b5-4535-8943-9ed5791ef8f3,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:52.177475 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-bf0d0772-a4c4-4e8f-87a1-7a875c853c0a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:52.179052 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-bf0d0772-a4c4-4e8f-87a1-7a875c853c0a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/networks?id=d9d87ca8-7863-48a6-937c-ee712996776e HTTP/1.1" status: 200 len: 811 time: 0.1060324 Nov 24 11:19:52.195970 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-7bd4361d-835e-473d-8763-8b9e7c5f6bca tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/quotas/907128185ff9473381be53050d202838 HTTP/1.1" status: 200 len: 375 time: 0.0109098 Nov 24 11:19:52.248755 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-1ef7fa83-4541-4d6e-9a23-f999b97f3683 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=907128185ff9473381be53050d202838&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0471358 Nov 24 11:19:52.351430 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-0011bee0-1b8c-4ac3-a476-84d00ecf911f service neutron] 10.222.0.76 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0902777 Nov 24 11:19:52.444444 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-709e1a9b-fc60-4db5-984b-fca3490c3f8d service neutron] 10.222.0.76 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869641 Nov 24 11:19:52.693533 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-311043ce-f13e-4d78-aa10-296cf730b3e8 req-2144b08b-61f5-4dce-b0dd-ecd1b2cc8379 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 210 time: 0.0351684 Nov 24 11:19:53.793915 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ea489608-6c17-4c2d-a7ed-8801d470862c req-b6cf61ee-540b-48f0-aa5e-dd7411845880 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 210 time: 0.0271869 Nov 24 11:19:54.076197 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:19:54.414696 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59420) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:54.518793 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0fa71c8f-d938-4c24-a268-12d4b3b3b46f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:54.593031 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0fa71c8f-d938-4c24-a268-12d4b3b3b46f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:54.662223 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-409e7992-c783-4046-8305-a66f2f58c62e tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:54.663681 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-409e7992-c783-4046-8305-a66f2f58c62e tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.86 "GET /v2.0/networks?id=d9d87ca8-7863-48a6-937c-ee712996776e HTTP/1.1" status: 200 len: 811 time: 0.1013160 Nov 24 11:19:54.677904 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0fa71c8f-d938-4c24-a268-12d4b3b3b46f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:54.717852 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-0fa71c8f-d938-4c24-a268-12d4b3b3b46f admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=87b4970625fc4eac9778f9dec3cd8284&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3019831 Nov 24 11:19:54.718685 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fa71c8f-d938-4c24-a268-12d4b3b3b46f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c98b4118-e9e9-4cdd-a314-45813f88c3a2,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:54.721618 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59424) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:54.729244 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-abfb3e54-9940-4c23-9d07-2834bcb2beaa tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=907128185ff9473381be53050d202838 HTTP/1.1" status: 200 len: 379 time: 0.0555928 Nov 24 11:19:54.742518 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Request body: {'port': {'device_id': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'admin_state_up': True, 'tenant_id': '907128185ff9473381be53050d202838', 'security_groups': ['bb1075fc-6aff-413d-aede-b8cd5b582753']}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:54.775120 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7c9d962f-fadd-4a65-8a6b-3bccae4df251 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:54.798054 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7c9d962f-fadd-4a65-8a6b-3bccae4df251 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:54.890147 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b9a827b3-9991-4419-9e93-df93d325d133 req-10c496d0-71b7-41a5-86bd-869fd0151964 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 210 time: 0.0261431 Nov 24 11:19:54.914994 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7c9d962f-fadd-4a65-8a6b-3bccae4df251 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:54.919008 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7c9d962f-fadd-4a65-8a6b-3bccae4df251 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:54.919008 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-7c9d962f-fadd-4a65-8a6b-3bccae4df251 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/c98b4118-e9e9-4cdd-a314-45813f88c3a2 HTTP/1.1" status: 204 len: 168 time: 0.1962092 Nov 24 11:19:54.926759 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c9d962f-fadd-4a65-8a6b-3bccae4df251 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c98b4118-e9e9-4cdd-a314-45813f88c3a2,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:54.961016 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Made reservation on behalf of 907128185ff9473381be53050d202838 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:19:54.964817 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.098224 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Allocated IP 172.20.0.12 (d9d87ca8-7863-48a6-937c-ee712996776e/c0d420cf-0b8e-4f90-a25c-9a74e1eafabb/dafd269f-c5b4-41c6-b4f9-8869f4f91f59) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:19:55.239790 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.363348 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.414088 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Network d9d87ca8-7863-48a6-937c-ee712996776e is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:19:55.417181 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:19:55.419623 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:19:55.445825 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event updated for resources: {'Port': ['ID=dafd269f-c5b4-41c6-b4f9-8869f4f91f59,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:55.478762 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:55.479405 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.579037 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-cb3c478e-c16c-4a27-9915-357166a9be2a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8404160 Nov 24 11:19:55.593578 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Request body: {'port': {'device_id': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:19:55.608426 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-4ce95fdc-6ffa-4d50-8e89-27efa08c837f None None] Provisioning complete for port dafd269f-c5b4-41c6-b4f9-8869f4f91f59 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:19:55.608928 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4ce95fdc-6ffa-4d50-8e89-27efa08c837f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.632237 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59440) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:55.644754 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-4ce95fdc-6ffa-4d50-8e89-27efa08c837f None None] Port dafd269f-c5b4-41c6-b4f9-8869f4f91f59 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:19:55.646349 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.647266 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f93df812-a6d6-4ac8-9233-51eceae2a266 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.722698 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f93df812-a6d6-4ac8-9233-51eceae2a266 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.773016 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f93df812-a6d6-4ac8-9233-51eceae2a266 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.813201 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-f93df812-a6d6-4ac8-9233-51eceae2a266 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=bfffbf32125a4281947907b9da33e838&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1795363 Nov 24 11:19:55.814057 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f93df812-a6d6-4ac8-9233-51eceae2a266 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f6f3db95-5c20-46d9-89ff-a3082665bffd,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:55.817068 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59442) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:19:55.866597 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-53c00438-ba31-44a3-a5f3-80626d752f7b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.887608 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-53c00438-ba31-44a3-a5f3-80626d752f7b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.911372 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id dafd269f-c5b4-41c6-b4f9-8869f4f91f59 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:19:55.919616 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.991176 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-53c00438-ba31-44a3-a5f3-80626d752f7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.991472 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Transition to ACTIVE for port object dafd269f-c5b4-41c6-b4f9-8869f4f91f59 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:19:55.993776 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-53c00438-ba31-44a3-a5f3-80626d752f7b admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:55.994912 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-53c00438-ba31-44a3-a5f3-80626d752f7b admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/f6f3db95-5c20-46d9-89ff-a3082665bffd HTTP/1.1" status: 204 len: 168 time: 0.1767926 Nov 24 11:19:56.006937 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53c00438-ba31-44a3-a5f3-80626d752f7b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f6f3db95-5c20-46d9-89ff-a3082665bffd,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:56.023201 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7afa53d-d274-4f45-b42a-aec8579ec543 req-15e4a1a9-9322-4abd-b7cc-a0593e043160 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:56.024756 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a7afa53d-d274-4f45-b42a-aec8579ec543 req-15e4a1a9-9322-4abd-b7cc-a0593e043160 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 932 time: 0.0643106 Nov 24 11:19:56.037891 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:56.075354 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a7afa53d-d274-4f45-b42a-aec8579ec543 req-9881f155-4f1c-48ef-99ed-f51f9fedd320 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=bb1075fc-6aff-413d-aede-b8cd5b582753&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444531 Nov 24 11:19:56.155371 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Pushing event updated for resources: {'Port': ['ID=dafd269f-c5b4-41c6-b4f9-8869f4f91f59,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:56.188331 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Attempting to bind port dafd269f-c5b4-41c6-b4f9-8869f4f91f59 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:19:56.188666 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Attempting to bind port dafd269f-c5b4-41c6-b4f9-8869f4f91f59 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:19:56.189000 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Attempting to bind port dafd269f-c5b4-41c6-b4f9-8869f4f91f59 on network d9d87ca8-7863-48a6-937c-ee712996776e {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:19:56.194246 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Port dafd269f-c5b4-41c6-b4f9-8869f4f91f59 on network d9d87ca8-7863-48a6-937c-ee712996776e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:19:56.198253 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Attempting to bind port dafd269f-c5b4-41c6-b4f9-8869f4f91f59 on network d9d87ca8-7863-48a6-937c-ee712996776e {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:19:56.200039 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 19, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:19:56.200374 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Checking segment: {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:19:56.200752 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Bound using segment: {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:19:56.201224 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Bound port: dafd269f-c5b4-41c6-b4f9-8869f4f91f59, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '79007d98-8337-4c9d-b362-284f4dc6590e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:19:56.201570 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:56.279967 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] For port dafd269f-c5b4-41c6-b4f9-8869f4f91f59, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:19:56.285901 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] For port dafd269f-c5b4-41c6-b4f9-8869f4f91f59, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=dafd269f-c5b4-41c6-b4f9-8869f4f91f59,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:19:56.351831 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:56.386673 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:56.387494 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:56.388868 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] 10.222.0.86 "PUT /v2.0/ports/dafd269f-c5b4-41c6-b4f9-8869f4f91f59 HTTP/1.1" status: 200 len: 1094 time: 0.7993226 Nov 24 11:19:56.391334 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'tag': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:19:56.393758 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-40a5e00c-a791-4b35-924a-d7ae034465c1" -d '{"events": [{"name": "network-changed", "server_uuid": "33c1d885-8008-4c47-95d3-dba8aaf38176", "tag": "dafd269f-c5b4-41c6-b4f9-8869f4f91f59"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:19:56.438275 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:19:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e629e3ee-6ab5-4332-aa8c-ae76024c341a x-openstack-request-id: req-e629e3ee-6ab5-4332-aa8c-ae76024c341a {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:19:56.438881 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "33c1d885-8008-4c47-95d3-dba8aaf38176", "tag": "dafd269f-c5b4-41c6-b4f9-8869f4f91f59", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:19:56.439173 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-e629e3ee-6ab5-4332-aa8c-ae76024c341a {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:19:56.439588 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'tag': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59', 'status': 'completed', 'code': 200} Nov 24 11:19:56.450618 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b577fa16-7706-439c-8a2c-fff03e9b523b service neutron] Pushing event updated for resources: {'Port': ['ID=dafd269f-c5b4-41c6-b4f9-8869f4f91f59,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:19:56.508999 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a5e00c-a791-4b35-924a-d7ae034465c1 req-b03ff3b3-85ef-4423-9ea5-7c23c1332bf1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:56.510259 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-40a5e00c-a791-4b35-924a-d7ae034465c1 req-b03ff3b3-85ef-4423-9ea5-7c23c1332bf1 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=907128185ff9473381be53050d202838&device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 1097 time: 0.0478785 Nov 24 11:19:56.618172 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a5e00c-a791-4b35-924a-d7ae034465c1 req-13af24f8-ce5d-4e2e-842d-74b3093de8e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:56.619670 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-40a5e00c-a791-4b35-924a-d7ae034465c1 req-13af24f8-ce5d-4e2e-842d-74b3093de8e4 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=907128185ff9473381be53050d202838&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1008830 Nov 24 11:19:56.717808 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40a5e00c-a791-4b35-924a-d7ae034465c1 req-70246c8c-04fd-422f-bfd7-8bfcbd246e26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:56.719261 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-40a5e00c-a791-4b35-924a-d7ae034465c1 req-70246c8c-04fd-422f-bfd7-8bfcbd246e26 service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.0917575 Nov 24 11:19:56.810260 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-005b2a78-5b3c-4b93-a8e9-6f5add21b24c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:56.811753 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-005b2a78-5b3c-4b93-a8e9-6f5add21b24c service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=907128185ff9473381be53050d202838&device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 1097 time: 0.0448465 Nov 24 11:19:56.860145 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-1ebcda75-3b25-434b-879c-1eaaf4d19b3d service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=dafd269f-c5b4-41c6-b4f9-8869f4f91f59 HTTP/1.1" status: 200 len: 217 time: 0.0344934 Nov 24 11:19:56.909061 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-93fdc4e8-b008-496b-917d-006cf28039d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:56.910495 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-93fdc4e8-b008-496b-917d-006cf28039d6 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c0d420cf-0b8e-4f90-a25c-9a74e1eafabb HTTP/1.1" status: 200 len: 850 time: 0.0416675 Nov 24 11:19:56.960151 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-10b5de6b-c33e-4fd0-943c-022d13e4ad00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:56.961521 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-10b5de6b-c33e-4fd0-943c-022d13e4ad00 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=d9d87ca8-7863-48a6-937c-ee712996776e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0428569 Nov 24 11:19:57.052361 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-4eb144df-8067-49e0-b333-df1aa6eae572 service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830450 Nov 24 11:19:57.149820 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9decdc74-8b2b-4b3d-bdf9-1b79277f8240 req-79dd0532-0b16-4d63-a09e-a444b0014f3f service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867827 Nov 24 11:19:57.220651 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-674c64bc-8206-40cf-8a44-d0020cc5d867 req-ceb6d4f0-212a-4488-bc54-85b9af922acd tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:57.222054 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-674c64bc-8206-40cf-8a44-d0020cc5d867 req-ceb6d4f0-212a-4488-bc54-85b9af922acd tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 944 time: 0.0568917 Nov 24 11:19:57.270531 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-674c64bc-8206-40cf-8a44-d0020cc5d867 req-ee0d7046-b6c4-4d40-8cda-92c7b0a595d0 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=bb1075fc-6aff-413d-aede-b8cd5b582753&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417025 Nov 24 11:19:58.366859 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-8feb9811-601c-47fd-bcf4-759cd794a493 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1375630280&fields=id&tenant_id=89e9b1abd4814b03ae8c95c5918bef03 HTTP/1.1" status: 200 len: 267 time: 0.0581579 Nov 24 11:19:58.461763 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-347ef656-78f4-44c3-8426-ae7d0e060b6e req-a52d0368-cbc7-45ac-9ed0-b7bc56e501e3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:58.463266 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-347ef656-78f4-44c3-8426-ae7d0e060b6e req-a52d0368-cbc7-45ac-9ed0-b7bc56e501e3 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 944 time: 0.1103597 Nov 24 11:19:58.764989 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-5b63d07b-5b5e-4666-992c-23d367f793ab tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:19:58.766435 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-5b63d07b-5b5e-4666-992c-23d367f793ab tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/networks?id=6b81a015-9685-4892-8d78-2a713f48dc53 HTTP/1.1" status: 200 len: 809 time: 0.3864617 Nov 24 11:19:58.785179 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-347ef656-78f4-44c3-8426-ae7d0e060b6e req-a817a30d-bed8-40a0-88d7-c783a5782839 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=bb1075fc-6aff-413d-aede-b8cd5b582753&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3146167 Nov 24 11:19:58.788019 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-eda0136a-8612-422a-b0ee-8702e30f94c1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/quotas/89e9b1abd4814b03ae8c95c5918bef03 HTTP/1.1" status: 200 len: 375 time: 0.0128751 Nov 24 11:19:58.841844 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-d1df19f8-a4ce-43ef-a0f2-cd6add640de0 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=89e9b1abd4814b03ae8c95c5918bef03&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0481360 Nov 24 11:19:58.944979 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-ec043be9-77d2-4cde-87ac-e18da24ba5c6 service neutron] 10.222.0.76 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0895863 Nov 24 11:19:59.036640 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-c978a2fe-c66d-44fd-9ffe-3668e6eced72 service neutron] 10.222.0.76 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0855987 Nov 24 11:19:59.541464 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device dafd269f-c5b4-41c6-b4f9-8869f4f91f59 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:19:59.643671 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port dafd269f-c5b4-41c6-b4f9-8869f4f91f59, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=dafd269f-c5b4-41c6-b4f9-8869f4f91f59,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:59.654523 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'port_id': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59', 'mac_address': 'fa:16:3e:85:8a:6a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1216, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:19:59.690840 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:59.709153 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id dafd269f-c5b4-41c6-b4f9-8869f4f91f59 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:19:59.728569 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port dafd269f-c5b4-41c6-b4f9-8869f4f91f59, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=dafd269f-c5b4-41c6-b4f9-8869f4f91f59,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:19:59.833563 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:19:59.910681 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ce667d30-0a74-4088-a08c-fd1978228aba req-d329f198-2d16-446b-b94e-631f617cb5a1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 210 time: 0.0397954 Nov 24 11:20:00.010877 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=dafd269f-c5b4-41c6-b4f9-8869f4f91f59,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:00.085939 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff60e98d-8dfd-491b-af21-d21690badb02 req-2701dbb7-ecc7-4859-891b-b650a144a3ee tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:00.087464 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff60e98d-8dfd-491b-af21-d21690badb02 req-2701dbb7-ecc7-4859-891b-b650a144a3ee tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 945 time: 0.2044375 Nov 24 11:20:00.111710 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['dafd269f-c5b4-41c6-b4f9-8869f4f91f59'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:20:00.138687 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff60e98d-8dfd-491b-af21-d21690badb02 req-19e8517c-a998-48b5-a1ae-fae7410cc3c6 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=bb1075fc-6aff-413d-aede-b8cd5b582753&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453284 Nov 24 11:20:01.004355 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-64b889e5-e510-41d7-85f5-4e1fd5fa859d req-3fbacafd-ed31-4f9d-bd00-bfb51f58b8f4 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 210 time: 0.0291114 Nov 24 11:20:01.258571 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d7dbbc-ee75-4a0a-a78b-5ae333e747df req-1722de00-a3bd-4038-a4b5-65cc4ac6374a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:01.260087 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c3d7dbbc-ee75-4a0a-a78b-5ae333e747df req-1722de00-a3bd-4038-a4b5-65cc4ac6374a tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 945 time: 0.0528369 Nov 24 11:20:01.307797 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c3d7dbbc-ee75-4a0a-a78b-5ae333e747df req-2dc5252c-06f3-403b-814a-0f18211463fe tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=bb1075fc-6aff-413d-aede-b8cd5b582753&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417569 Nov 24 11:20:01.555805 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device dafd269f-c5b4-41c6-b4f9-8869f4f91f59 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:20:01.681980 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port dafd269f-c5b4-41c6-b4f9-8869f4f91f59 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:20:01.685993 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port dafd269f-c5b4-41c6-b4f9-8869f4f91f59 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:20:01.686358 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:01.762695 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:01.784556 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:20:01.787137 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4c703f54-7e45-4dc4-b91f-b7d5cecaa18c" -d '{"events": [{"server_uuid": "33c1d885-8008-4c47-95d3-dba8aaf38176", "name": "network-vif-plugged", "status": "completed", "tag": "dafd269f-c5b4-41c6-b4f9-8869f4f91f59"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:20:01.804898 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port dafd269f-c5b4-41c6-b4f9-8869f4f91f59, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=dafd269f-c5b4-41c6-b4f9-8869f4f91f59,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:01.827451 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:20:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d93688ce-ec25-4b65-ba26-85e19dce8a05 x-openstack-request-id: req-d93688ce-ec25-4b65-ba26-85e19dce8a05 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:20:01.827749 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "33c1d885-8008-4c47-95d3-dba8aaf38176", "name": "network-vif-plugged", "status": "completed", "tag": "dafd269f-c5b4-41c6-b4f9-8869f4f91f59", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:20:01.828007 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-d93688ce-ec25-4b65-ba26-85e19dce8a05 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:20:01.828398 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59', 'code': 200} Nov 24 11:20:01.877015 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:01.924846 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=dafd269f-c5b4-41c6-b4f9-8869f4f91f59,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:02.118294 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9e16e28e-f8e0-461a-b3ac-f20a00dea9b4 req-894dec70-bf35-4f38-a91f-fe0af8b078d1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 210 time: 0.0344367 Nov 24 11:20:02.121601 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-a128d821-d523-4296-a958-7daa8596bdeb tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:02.123303 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-a128d821-d523-4296-a958-7daa8596bdeb tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.86 "GET /v2.0/networks?id=6b81a015-9685-4892-8d78-2a713f48dc53 HTTP/1.1" status: 200 len: 809 time: 0.1107137 Nov 24 11:20:02.166800 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11735415-1359-4aeb-b9b2-482678fbc076 req-4ab93cf8-a5e4-407a-b544-03266b2966ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:02.168347 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-11735415-1359-4aeb-b9b2-482678fbc076 req-4ab93cf8-a5e4-407a-b544-03266b2966ed service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 1099 time: 0.0454764 Nov 24 11:20:02.194818 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-9b8ff939-3057-4b16-9f7c-0a7508aae1c5 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=89e9b1abd4814b03ae8c95c5918bef03 HTTP/1.1" status: 200 len: 380 time: 0.0592248 Nov 24 11:20:02.208638 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Request body: {'port': {'device_id': '19240268-0de5-4be0-9b3e-745da67e3b50', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'admin_state_up': True, 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'security_groups': ['cfe5fa37-1c99-4d49-a45d-e098df726cee']}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:20:02.218517 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-11735415-1359-4aeb-b9b2-482678fbc076 req-baff41ee-f870-4cd4-a3c7-aa2bf6a8b3cf service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=bb1075fc-6aff-413d-aede-b8cd5b582753&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411286 Nov 24 11:20:02.408640 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Made reservation on behalf of 89e9b1abd4814b03ae8c95c5918bef03 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:20:02.412122 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:02.424541 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676cacb4-4219-407a-8e9d-7adcf20f9949 req-cec60e32-322b-4e61-89d4-d22157619306 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:02.426021 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-676cacb4-4219-407a-8e9d-7adcf20f9949 req-cec60e32-322b-4e61-89d4-d22157619306 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 946 time: 0.0491157 Nov 24 11:20:02.482097 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-676cacb4-4219-407a-8e9d-7adcf20f9949 req-f5ea2b6e-1252-4b79-8c1a-42a7aeb4908f tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=bb1075fc-6aff-413d-aede-b8cd5b582753&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490925 Nov 24 11:20:02.547414 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Allocated IP 172.20.0.5 (6b81a015-9685-4892-8d78-2a713f48dc53/2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c/4309383c-b778-44aa-bd64-d0a29f77fb4d) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:20:02.681822 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:02.831556 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:02.877677 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Network 6b81a015-9685-4892-8d78-2a713f48dc53 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:20:02.882998 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:20:02.885445 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:20:02.924008 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event updated for resources: {'Port': ['ID=4309383c-b778-44aa-bd64-d0a29f77fb4d,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:02.945394 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:02.946570 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.023172 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b19afc37-6836-400f-a00c-148433e68591 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8183680 Nov 24 11:20:03.036537 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Request body: {'port': {'device_id': '19240268-0de5-4be0-9b3e-745da67e3b50', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:20:03.090289 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.150550 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-b95af60e-8082-442a-aa8a-bd17344fa040 None None] Provisioning complete for port 4309383c-b778-44aa-bd64-d0a29f77fb4d triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:20:03.151155 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b95af60e-8082-442a-aa8a-bd17344fa040 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.194665 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-b95af60e-8082-442a-aa8a-bd17344fa040 None None] Port 4309383c-b778-44aa-bd64-d0a29f77fb4d cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:20:03.270096 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d558fa5c-21a9-4ced-adaf-99ec688d33b7 req-04dd8533-a8df-4a04-bd15-836ef5dd4c43 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:03.272321 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d558fa5c-21a9-4ced-adaf-99ec688d33b7 req-04dd8533-a8df-4a04-bd15-836ef5dd4c43 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 931 time: 0.0613692 Nov 24 11:20:03.332788 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d558fa5c-21a9-4ced-adaf-99ec688d33b7 req-b1dfe70f-9de8-4f08-9e66-25f1b8749821 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460873 Nov 24 11:20:03.351863 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59604) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:03.392959 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4309383c-b778-44aa-bd64-d0a29f77fb4d {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:20:03.401352 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.414800 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Transition to ACTIVE for port object 4309383c-b778-44aa-bd64-d0a29f77fb4d will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:20:03.461461 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-cd0cec55-5c83-4a10-a6a7-f7b85fdb7448 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.522936 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.540575 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-cd0cec55-5c83-4a10-a6a7-f7b85fdb7448 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.623890 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-cd0cec55-5c83-4a10-a6a7-f7b85fdb7448 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.646179 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Pushing event updated for resources: {'Port': ['ID=4309383c-b778-44aa-bd64-d0a29f77fb4d,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:03.672970 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Attempting to bind port 4309383c-b778-44aa-bd64-d0a29f77fb4d on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:20:03.673304 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Attempting to bind port 4309383c-b778-44aa-bd64-d0a29f77fb4d by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:20:03.674669 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Attempting to bind port 4309383c-b778-44aa-bd64-d0a29f77fb4d on network 6b81a015-9685-4892-8d78-2a713f48dc53 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:20:03.680409 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Port 4309383c-b778-44aa-bd64-d0a29f77fb4d on network 6b81a015-9685-4892-8d78-2a713f48dc53 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:20:03.680524 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Attempting to bind port 4309383c-b778-44aa-bd64-d0a29f77fb4d on network 6b81a015-9685-4892-8d78-2a713f48dc53 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:20:03.686472 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 19, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:20:03.688216 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Checking segment: {'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:20:03.688216 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Bound using segment: {'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:20:03.688451 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Bound port: 4309383c-b778-44aa-bd64-d0a29f77fb4d, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8a5c6583-f0d2-4382-9e2b-b92e582459b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1239, 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:20:03.688638 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.696640 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-cd0cec55-5c83-4a10-a6a7-f7b85fdb7448 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=b0e167f338414b9f945251255ec90905&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3436904 Nov 24 11:20:03.698549 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59614) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:03.706018 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd0cec55-5c83-4a10-a6a7-f7b85fdb7448 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1252521a-5252-40b6-9d9c-a0932ea5a10b,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:03.741177 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dc81887-5bc3-4a45-afe9-b56750be3ef6 req-7bf9abd1-b549-4e3c-bbc7-748ea68975b2 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:03.759392 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8dc81887-5bc3-4a45-afe9-b56750be3ef6 req-7bf9abd1-b549-4e3c-bbc7-748ea68975b2 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 946 time: 0.1796184 Nov 24 11:20:03.807478 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] For port 4309383c-b778-44aa-bd64-d0a29f77fb4d, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:20:03.812860 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] For port 4309383c-b778-44aa-bd64-d0a29f77fb4d, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:20:03.838519 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c41aa264-ce56-4eb4-95c0-f09381f70adb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.863460 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8dc81887-5bc3-4a45-afe9-b56750be3ef6 req-d39b71d9-e3a9-458a-ba81-2404837b7a91 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=bb1075fc-6aff-413d-aede-b8cd5b582753&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0726709 Nov 24 11:20:03.872885 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c41aa264-ce56-4eb4-95c0-f09381f70adb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.894456 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.929531 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:03.930071 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:03.931474 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] 10.222.0.86 "PUT /v2.0/ports/4309383c-b778-44aa-bd64-d0a29f77fb4d HTTP/1.1" status: 200 len: 1093 time: 0.8992732 Nov 24 11:20:03.931913 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:20:03.934115 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c6412086-7efc-4d45-bfcb-bc0f26234f1d" -d '{"events": [{"name": "network-changed", "server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:20:03.960769 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9a79db8-e091-4cad-bb71-77189f677e3e service neutron] Pushing event updated for resources: {'Port': ['ID=4309383c-b778-44aa-bd64-d0a29f77fb4d,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:03.977226 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:20:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-274cfdb4-bb19-4408-885d-eabd7894b723 x-openstack-request-id: req-274cfdb4-bb19-4408-885d-eabd7894b723 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:20:03.977675 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:20:03.983482 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-274cfdb4-bb19-4408-885d-eabd7894b723 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:20:03.983482 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'status': 'completed', 'code': 200} Nov 24 11:20:04.002782 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c41aa264-ce56-4eb4-95c0-f09381f70adb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:04.005480 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c41aa264-ce56-4eb4-95c0-f09381f70adb admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:04.009498 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-c41aa264-ce56-4eb4-95c0-f09381f70adb admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/1252521a-5252-40b6-9d9c-a0932ea5a10b HTTP/1.1" status: 204 len: 168 time: 0.3062036 Nov 24 11:20:04.017898 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c41aa264-ce56-4eb4-95c0-f09381f70adb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1252521a-5252-40b6-9d9c-a0932ea5a10b,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:04.048055 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6412086-7efc-4d45-bfcb-bc0f26234f1d req-68f1a7ae-3e0f-4522-9129-e1e53fd3af91 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:04.050956 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c6412086-7efc-4d45-bfcb-bc0f26234f1d req-68f1a7ae-3e0f-4522-9129-e1e53fd3af91 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=89e9b1abd4814b03ae8c95c5918bef03&device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 1096 time: 0.0498142 Nov 24 11:20:04.158582 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6412086-7efc-4d45-bfcb-bc0f26234f1d req-7dd6c937-210e-4601-8077-016be41e065f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:04.160081 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c6412086-7efc-4d45-bfcb-bc0f26234f1d req-7dd6c937-210e-4601-8077-016be41e065f service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=89e9b1abd4814b03ae8c95c5918bef03&shared=False HTTP/1.1" status: 200 len: 911 time: 0.0998824 Nov 24 11:20:04.254106 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6412086-7efc-4d45-bfcb-bc0f26234f1d req-04c9945d-c5b9-455c-abcc-9af24d0d653f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:04.255604 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-c6412086-7efc-4d45-bfcb-bc0f26234f1d req-04c9945d-c5b9-455c-abcc-9af24d0d653f service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.0874937 Nov 24 11:20:04.339485 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-34ae3f82-79fc-44f6-93df-269b96713cce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:04.341058 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-34ae3f82-79fc-44f6-93df-269b96713cce service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=89e9b1abd4814b03ae8c95c5918bef03&device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 1096 time: 0.0461397 Nov 24 11:20:04.386306 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-c9a083b5-38c7-4ca0-9871-1f5a4b50ceaa service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d HTTP/1.1" status: 200 len: 217 time: 0.0339687 Nov 24 11:20:04.436771 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-27514d1d-c9e5-4f78-abec-cc66125e6e30 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:04.438220 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-27514d1d-c9e5-4f78-abec-cc66125e6e30 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c HTTP/1.1" status: 200 len: 848 time: 0.0439534 Nov 24 11:20:04.455374 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2e16fe-6723-4300-a433-f4bceb89b13c req-5e425036-2809-4dd1-be16-188decd7774b tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:04.457098 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fc2e16fe-6723-4300-a433-f4bceb89b13c req-5e425036-2809-4dd1-be16-188decd7774b tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0491288 Nov 24 11:20:04.489982 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-bd3b8559-f149-4209-9c88-67d381a9aad4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:04.491611 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-bd3b8559-f149-4209-9c88-67d381a9aad4 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b81a015-9685-4892-8d78-2a713f48dc53&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0443683 Nov 24 11:20:04.506982 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fc2e16fe-6723-4300-a433-f4bceb89b13c req-3dcad8db-48ea-4422-b68f-e6ee97787952 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426919 Nov 24 11:20:04.581853 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-2536f670-c6db-40b3-8791-c477818d1271 service neutron] 10.222.0.86 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821023 Nov 24 11:20:04.676179 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-197e8b0e-3f99-4c6f-a2eb-9b5b80ec6c89 req-58b11c96-5d1c-4361-812d-eb7c1b69c5b4 service neutron] 10.222.0.86 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860603 Nov 24 11:20:04.688363 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59624) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:04.704423 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5212bfb1-d77f-4254-a951-dff9d2c0c892 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:04.776410 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5212bfb1-d77f-4254-a951-dff9d2c0c892 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:04.863829 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5212bfb1-d77f-4254-a951-dff9d2c0c892 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:04.903809 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-5212bfb1-d77f-4254-a951-dff9d2c0c892 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=ebf9c542872f41c383097b355d22d293&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2143836 Nov 24 11:20:04.905866 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5212bfb1-d77f-4254-a951-dff9d2c0c892 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2bd2c5f-c516-4490-a5e0-6362867bd7f0,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:04.906449 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 59630) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:04.960219 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1a5919a4-f7b0-4877-a9d7-aeb958f77939 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:04.981203 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1a5919a4-f7b0-4877-a9d7-aeb958f77939 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:04.981777 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-532d6235-41de-4e32-b885-0c88dae564b9 req-67c23313-ae55-4c41-bf84-fb05bed40a4d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:04.983255 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-532d6235-41de-4e32-b885-0c88dae564b9 req-67c23313-ae55-4c41-bf84-fb05bed40a4d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 946 time: 0.0490284 Nov 24 11:20:05.031215 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-532d6235-41de-4e32-b885-0c88dae564b9 req-ee516f70-6fc4-4688-b394-cc8b238ec583 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=bb1075fc-6aff-413d-aede-b8cd5b582753&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411644 Nov 24 11:20:05.093667 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1a5919a4-f7b0-4877-a9d7-aeb958f77939 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:05.096386 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1a5919a4-f7b0-4877-a9d7-aeb958f77939 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:05.097538 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-1a5919a4-f7b0-4877-a9d7-aeb958f77939 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/d2bd2c5f-c516-4490-a5e0-6362867bd7f0 HTTP/1.1" status: 204 len: 168 time: 0.1900697 Nov 24 11:20:05.106607 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a5919a4-f7b0-4877-a9d7-aeb958f77939 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2bd2c5f-c516-4490-a5e0-6362867bd7f0,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:05.148463 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2698b2d-2f09-4639-87dc-ed9655dd7d21 req-5a968afa-21be-4154-97c0-4679c8cda60f tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:05.149976 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e2698b2d-2f09-4639-87dc-ed9655dd7d21 req-5a968afa-21be-4154-97c0-4679c8cda60f tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 946 time: 0.0545230 Nov 24 11:20:05.158776 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59636) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:05.164938 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-c9b5d0e1-ab05-438e-9385-dea83c193230 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Request body: {'floatingip': {'port_id': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:20:05.204523 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c9b5d0e1-ab05-438e-9385-dea83c193230 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:05.682169 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf0a208-8059-4ed1-b045-983200920d48 req-8c4dae4c-9a84-444b-9100-325d77d44849 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:05.683591 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-adf0a208-8059-4ed1-b045-983200920d48 req-8c4dae4c-9a84-444b-9100-325d77d44849 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.1024306 Nov 24 11:20:05.685532 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c9b5d0e1-ab05-438e-9385-dea83c193230 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:05.728671 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 59644) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:05.736453 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-adf0a208-8059-4ed1-b045-983200920d48 req-6b4501c9-e8a4-4ab2-bb4e-86537eaddbda tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461364 Nov 24 11:20:05.741791 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cccc90d0-506d-40a7-bcb2-ca14498ae022 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:05.751260 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c9b5d0e1-ab05-438e-9385-dea83c193230 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:05.817920 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cccc90d0-506d-40a7-bcb2-ca14498ae022 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:05.853698 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.l3_db [None req-c9b5d0e1-ab05-438e-9385-dea83c193230 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Floating IP a7086214-f429-4a3a-899d-d76c53c3e20f associated. External IP: 172.27.3.50, port: dafd269f-c5b4-41c6-b4f9-8869f4f91f59. Nov 24 11:20:05.865223 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-cccc90d0-506d-40a7-bcb2-ca14498ae022 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:05.902953 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-cccc90d0-506d-40a7-bcb2-ca14498ae022 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=c69a5e857bde4f55a6a630508512097e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1731997 Nov 24 11:20:05.904905 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cccc90d0-506d-40a7-bcb2-ca14498ae022 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1764e9c2-75b9-417b-b5eb-9b22af965dcc,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:05.905594 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59646) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:05.999262 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ea691fb6-44e1-468e-bcfe-34dc5f805cc5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:06.060253 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ea691fb6-44e1-468e-bcfe-34dc5f805cc5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:06.141152 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9b5d0e1-ab05-438e-9385-dea83c193230 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:20:06.226579 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ea691fb6-44e1-468e-bcfe-34dc5f805cc5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:06.229113 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ea691fb6-44e1-468e-bcfe-34dc5f805cc5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:06.230233 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-ea691fb6-44e1-468e-bcfe-34dc5f805cc5 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/1764e9c2-75b9-417b-b5eb-9b22af965dcc HTTP/1.1" status: 204 len: 168 time: 0.3237212 Nov 24 11:20:06.242349 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea691fb6-44e1-468e-bcfe-34dc5f805cc5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1764e9c2-75b9-417b-b5eb-9b22af965dcc,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:06.263148 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9b5d0e1-ab05-438e-9385-dea83c193230 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:20:06.267414 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c9b5d0e1-ab05-438e-9385-dea83c193230 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:06.274649 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71cf9d0c-1255-4db3-96ff-d9dcc5d47422 None None] Sync routers for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:20:06.284918 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71cf9d0c-1255-4db3-96ff-d9dcc5d47422 None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:20:06.285537 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-71cf9d0c-1255-4db3-96ff-d9dcc5d47422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:06.295489 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-c9b5d0e1-ab05-438e-9385-dea83c193230 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "PUT /v2.0/floatingips/a7086214-f429-4a3a-899d-d76c53c3e20f HTTP/1.1" status: 200 len: 991 time: 1.1354914 Nov 24 11:20:06.296075 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'tag': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:20:06.298306 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-15ce6361-c5b7-47d9-97d8-ee88b96b45c1" -d '{"events": [{"name": "network-changed", "server_uuid": "33c1d885-8008-4c47-95d3-dba8aaf38176", "tag": "dafd269f-c5b4-41c6-b4f9-8869f4f91f59"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:20:06.370775 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:20:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9c0069bc-2e69-46cd-9fae-aa5dba43ffa5 x-openstack-request-id: req-9c0069bc-2e69-46cd-9fae-aa5dba43ffa5 {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:20:06.371072 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "33c1d885-8008-4c47-95d3-dba8aaf38176", "tag": "dafd269f-c5b4-41c6-b4f9-8869f4f91f59", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:20:06.371418 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-9c0069bc-2e69-46cd-9fae-aa5dba43ffa5 {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:20:06.371840 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'tag': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59', 'status': 'completed', 'code': 200} Nov 24 11:20:06.396369 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-71cf9d0c-1255-4db3-96ff-d9dcc5d47422 None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:20:06.633504 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-71cf9d0c-1255-4db3-96ff-d9dcc5d47422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': 'a7086214-f429-4a3a-899d-d76c53c3e20f', 'tenant_id': '907128185ff9473381be53050d202838', 'floating_ip_address': '172.27.3.50', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'port_id': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 495, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'mac_address': 'fa:16:3e:85:8a:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:19:51Z', 'updated_at': '2021-11-24T11:20:05Z', 'revision_number': 1, 'project_id': '907128185ff9473381be53050d202838', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:11Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:06.664036 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71cf9d0c-1255-4db3-96ff-d9dcc5d47422 None None] Checking router: 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:20:06.673769 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71cf9d0c-1255-4db3-96ff-d9dcc5d47422 None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:20:06.675390 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-71cf9d0c-1255-4db3-96ff-d9dcc5d47422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:19:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:06.690790 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ce6361-c5b7-47d9-97d8-ee88b96b45c1 req-7298f09f-e999-48c5-b461-ee85d625f958 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:06.692315 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15ce6361-c5b7-47d9-97d8-ee88b96b45c1 req-7298f09f-e999-48c5-b461-ee85d625f958 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=907128185ff9473381be53050d202838&device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 1099 time: 0.2977295 Nov 24 11:20:06.796106 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ce6361-c5b7-47d9-97d8-ee88b96b45c1 req-08d68685-6eaa-4f8c-979c-6b93ca4c9d73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:06.797671 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15ce6361-c5b7-47d9-97d8-ee88b96b45c1 req-08d68685-6eaa-4f8c-979c-6b93ca4c9d73 service neutron] 10.222.0.86 "GET /v2.0/networks?id=d9d87ca8-7863-48a6-937c-ee712996776e HTTP/1.1" status: 200 len: 913 time: 0.0978117 Nov 24 11:20:06.808777 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-71cf9d0c-1255-4db3-96ff-d9dcc5d47422 None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:20:06.876631 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15ce6361-c5b7-47d9-97d8-ee88b96b45c1 req-6cf5d66b-7e21-4a53-9930-50d1a28f96c8 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=dafd269f-c5b4-41c6-b4f9-8869f4f91f59 HTTP/1.1" status: 200 len: 999 time: 0.0702877 Nov 24 11:20:06.879814 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37d259b2-2eff-4fef-b6b3-41e30cfca8b6 req-3f2391ef-2b03-4bd3-a0e6-53c9f2728220 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:06.881465 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-37d259b2-2eff-4fef-b6b3-41e30cfca8b6 req-3f2391ef-2b03-4bd3-a0e6-53c9f2728220 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0560145 Nov 24 11:20:06.945314 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-37d259b2-2eff-4fef-b6b3-41e30cfca8b6 req-b7147738-259c-4f15-b3d2-de56e4dc324e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0565367 Nov 24 11:20:06.946394 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ce6361-c5b7-47d9-97d8-ee88b96b45c1 req-e8eb2646-f42f-49ed-ae32-e6c836b62a41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:06.947894 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15ce6361-c5b7-47d9-97d8-ee88b96b45c1 req-e8eb2646-f42f-49ed-ae32-e6c836b62a41 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=c0d420cf-0b8e-4f90-a25c-9a74e1eafabb HTTP/1.1" status: 200 len: 850 time: 0.0630558 Nov 24 11:20:06.999322 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15ce6361-c5b7-47d9-97d8-ee88b96b45c1 req-1effb8ce-54f4-4b03-9c42-43ac6a95483a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:07.000816 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15ce6361-c5b7-47d9-97d8-ee88b96b45c1 req-1effb8ce-54f4-4b03-9c42-43ac6a95483a service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=d9d87ca8-7863-48a6-937c-ee712996776e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0436862 Nov 24 11:20:07.071387 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-71cf9d0c-1255-4db3-96ff-d9dcc5d47422 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': 'a7086214-f429-4a3a-899d-d76c53c3e20f', 'tenant_id': '907128185ff9473381be53050d202838', 'floating_ip_address': '172.27.3.50', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'port_id': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 495, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'mac_address': 'fa:16:3e:85:8a:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:19:51Z', 'updated_at': '2021-11-24T11:20:05Z', 'revision_number': 1, 'project_id': '907128185ff9473381be53050d202838', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:11Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:07.100527 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15ce6361-c5b7-47d9-97d8-ee88b96b45c1 req-d28ba0bc-1448-4ae3-a7d3-ad180593416d service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907848 Nov 24 11:20:07.104912 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71cf9d0c-1255-4db3-96ff-d9dcc5d47422 None None] The sync data for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi is: [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': 'a7086214-f429-4a3a-899d-d76c53c3e20f', 'tenant_id': '907128185ff9473381be53050d202838', 'floating_ip_address': '172.27.3.50', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'port_id': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 495, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'mac_address': 'fa:16:3e:85:8a:6a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:19:51Z', 'updated_at': '2021-11-24T11:20:05Z', 'revision_number': 1, 'project_id': '907128185ff9473381be53050d202838', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:11Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:20:07.223414 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-15ce6361-c5b7-47d9-97d8-ee88b96b45c1 req-08d8d9d1-a4fa-4fdf-8c95-1f9b24ef9be0 service neutron] 10.222.0.86 "GET /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1086452 Nov 24 11:20:07.306201 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86d07541-36d9-47a2-a765-af98e460b590 None None] New status for floating IP a7086214-f429-4a3a-899d-d76c53c3e20f: ACTIVE {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:20:08.071065 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97932268-c2a3-4406-a73e-417829aef70c req-71712bb0-6faa-4f3a-878e-b910acfe27f0 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:08.072592 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-97932268-c2a3-4406-a73e-417829aef70c req-71712bb0-6faa-4f3a-878e-b910acfe27f0 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0511873 Nov 24 11:20:08.123507 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-97932268-c2a3-4406-a73e-417829aef70c req-66619c5f-c846-433b-a8cd-8b6218c1403d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450485 Nov 24 11:20:08.743804 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-7475fd61-9f4f-4186-8e8d-1219b60f6375 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:09.179561 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:09.247715 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-781dbead-751b-4e29-9149-5446520ca295 req-ca9d6dc4-d26e-41cd-b233-f95e435c3ca7 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:09.249186 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-781dbead-751b-4e29-9149-5446520ca295 req-ca9d6dc4-d26e-41cd-b233-f95e435c3ca7 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0542238 Nov 24 11:20:09.297797 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-781dbead-751b-4e29-9149-5446520ca295 req-83bcffaf-d141-4208-a45a-30b31eb482dc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424628 Nov 24 11:20:09.429174 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59740) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:09.532696 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9801bf56-9ac8-408e-95be-9f6b80d09398 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:09.604765 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9801bf56-9ac8-408e-95be-9f6b80d09398 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:09.676264 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-9801bf56-9ac8-408e-95be-9f6b80d09398 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:09.714035 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9801bf56-9ac8-408e-95be-9f6b80d09398 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ca996f2-bcb6-4383-863f-301cbeb953f5,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:09.718102 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-9801bf56-9ac8-408e-95be-9f6b80d09398 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=ec32f5ce370c49658fef9c7e0739ab0c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2879333 Nov 24 11:20:09.720733 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59746) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:09.774274 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2a8ba6da-9bf9-4219-b515-ebf578cae6c9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:09.795912 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2a8ba6da-9bf9-4219-b515-ebf578cae6c9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:09.904895 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2a8ba6da-9bf9-4219-b515-ebf578cae6c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:09.907499 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2a8ba6da-9bf9-4219-b515-ebf578cae6c9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:09.908651 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2a8ba6da-9bf9-4219-b515-ebf578cae6c9 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/0ca996f2-bcb6-4383-863f-301cbeb953f5 HTTP/1.1" status: 204 len: 168 time: 0.1869240 Nov 24 11:20:09.916438 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a8ba6da-9bf9-4219-b515-ebf578cae6c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ca996f2-bcb6-4383-863f-301cbeb953f5,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:10.420785 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7e23fc8-94c8-4d48-92e6-59e9b0e26bf3 req-425a8907-a0af-441c-86e2-53efe0a3d75f tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:10.422559 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d7e23fc8-94c8-4d48-92e6-59e9b0e26bf3 req-425a8907-a0af-441c-86e2-53efe0a3d75f tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0516911 Nov 24 11:20:10.475616 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d7e23fc8-94c8-4d48-92e6-59e9b0e26bf3 req-90b82d8e-a478-4151-b187-25e1568c3107 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471339 Nov 24 11:20:10.605481 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59758) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:10.619333 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-751dfe75-db0f-4224-89df-2995cd38b2e3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:10.691621 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-751dfe75-db0f-4224-89df-2995cd38b2e3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:10.739653 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9dc52d4a-76f4-45f6-b38c-73b7b1296f95 req-96077b5d-07b3-4797-96b1-1a3f52014388 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0445795 Nov 24 11:20:10.768304 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-751dfe75-db0f-4224-89df-2995cd38b2e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:10.811650 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-751dfe75-db0f-4224-89df-2995cd38b2e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd943b7f-1d16-4554-8f82-661fe611be3a,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:10.820306 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 59762) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:10.820984 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-751dfe75-db0f-4224-89df-2995cd38b2e3 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=29e7084032494370a60d3b9a26161c41&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2142961 Nov 24 11:20:10.849791 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc52d4a-76f4-45f6-b38c-73b7b1296f95 req-3480285b-432a-4aad-b5f0-8e1d5b92dca8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:10.851494 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9dc52d4a-76f4-45f6-b38c-73b7b1296f95 req-3480285b-432a-4aad-b5f0-8e1d5b92dca8 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=41b5f46d34ad4033a154a9afabe2091f&device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 1138 time: 0.0659039 Nov 24 11:20:10.886778 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd4505aa-f499-499b-b5c0-e5077d670f80 req-7437bf4a-fe0a-404f-a3d7-5906f7b55421 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-122985791&fields=id&tenant_id=41b5f46d34ad4033a154a9afabe2091f HTTP/1.1" status: 200 len: 267 time: 0.0527885 Nov 24 11:20:10.888007 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6803fdc4-07d7-4d99-975a-d385bc778798 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:10.942810 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4505aa-f499-499b-b5c0-e5077d670f80 req-07c2bfc5-1ea5-4ce2-80a6-e84bfbec9aa8 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:10.944462 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd4505aa-f499-499b-b5c0-e5077d670f80 req-07c2bfc5-1ea5-4ce2-80a6-e84bfbec9aa8 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 985 time: 0.0512092 Nov 24 11:20:10.954313 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6803fdc4-07d7-4d99-975a-d385bc778798 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:10.955476 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [req-bd4505aa-f499-499b-b5c0-e5077d670f80 req-a014aebd-6280-4d95-a32e-bb81c4c129f3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Request body: {'port': {'security_groups': ['77852028-b8f9-4fe3-8362-a7373cc59d6b']}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:20:11.009009 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc52d4a-76f4-45f6-b38c-73b7b1296f95 req-ac0640a3-5b1d-4778-be99-d0b4534b843b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:11.010465 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9dc52d4a-76f4-45f6-b38c-73b7b1296f95 req-ac0640a3-5b1d-4778-be99-d0b4534b843b service neutron] 10.222.0.86 "GET /v2.0/networks?id=c3a531f2-bfe9-4a80-8b71-ad7f35944879 HTTP/1.1" status: 200 len: 917 time: 0.1348610 Nov 24 11:20:11.028326 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-bd4505aa-f499-499b-b5c0-e5077d670f80 req-a014aebd-6280-4d95-a32e-bb81c4c129f3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.077690 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9dc52d4a-76f4-45f6-b38c-73b7b1296f95 req-9a132d5d-b1a9-4773-8ecf-edcb429dc46f service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=57415158-968f-4f63-9c5f-eba02f4dd725 HTTP/1.1" status: 200 len: 1002 time: 0.0583174 Nov 24 11:20:11.116512 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6803fdc4-07d7-4d99-975a-d385bc778798 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.119211 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6803fdc4-07d7-4d99-975a-d385bc778798 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.120353 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-6803fdc4-07d7-4d99-975a-d385bc778798 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/dd943b7f-1d16-4554-8f82-661fe611be3a HTTP/1.1" status: 204 len: 168 time: 0.2989967 Nov 24 11:20:11.133881 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6803fdc4-07d7-4d99-975a-d385bc778798 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd943b7f-1d16-4554-8f82-661fe611be3a,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:11.146573 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc52d4a-76f4-45f6-b38c-73b7b1296f95 req-b6a1dbc2-f415-483b-90c7-a3ce7694250f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:11.149863 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9dc52d4a-76f4-45f6-b38c-73b7b1296f95 req-b6a1dbc2-f415-483b-90c7-a3ce7694250f service neutron] 10.222.0.86 "GET /v2.0/subnets?id=08393eb4-7b60-4211-937a-8e0724891dbc HTTP/1.1" status: 200 len: 854 time: 0.0635233 Nov 24 11:20:11.191446 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f967b839-5ee1-4188-9fe4-a5bd2f2df592 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.201939 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc52d4a-76f4-45f6-b38c-73b7b1296f95 req-2b33b5a4-1646-4dd1-9348-6cbeef4251fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:11.203840 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9dc52d4a-76f4-45f6-b38c-73b7b1296f95 req-2b33b5a4-1646-4dd1-9348-6cbeef4251fa service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=c3a531f2-bfe9-4a80-8b71-ad7f35944879&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0463777 Nov 24 11:20:11.228059 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [req-bd4505aa-f499-499b-b5c0-e5077d670f80 req-a014aebd-6280-4d95-a32e-bb81c4c129f3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] For port 57415158-968f-4f63-9c5f-eba02f4dd725, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=57415158-968f-4f63-9c5f-eba02f4dd725,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:11.262098 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-bd4505aa-f499-499b-b5c0-e5077d670f80 req-a014aebd-6280-4d95-a32e-bb81c4c129f3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for port, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.300379 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9dc52d4a-76f4-45f6-b38c-73b7b1296f95 req-9bc5d692-815b-422f-8604-29c2ad828b4f service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874116 Nov 24 11:20:11.350737 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-bd4505aa-f499-499b-b5c0-e5077d670f80 req-a014aebd-6280-4d95-a32e-bb81c4c129f3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8699083'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.362535 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['57415158-968f-4f63-9c5f-eba02f4dd725'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:20:11.401612 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd4505aa-f499-499b-b5c0-e5077d670f80 req-a014aebd-6280-4d95-a32e-bb81c4c129f3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:11.402219 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-bd4505aa-f499-499b-b5c0-e5077d670f80 req-a014aebd-6280-4d95-a32e-bb81c4c129f3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.403456 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9dc52d4a-76f4-45f6-b38c-73b7b1296f95 req-ee54953f-017e-494c-9e19-43733f34f648 service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0955672 Nov 24 11:20:11.403596 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd4505aa-f499-499b-b5c0-e5077d670f80 req-a014aebd-6280-4d95-a32e-bb81c4c129f3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "PUT /v2.0/ports/57415158-968f-4f63-9c5f-eba02f4dd725 HTTP/1.1" status: 200 len: 943 time: 0.4526751 Nov 24 11:20:11.404058 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:20:11.406406 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-90b13289-7cab-49ad-b6ec-3b9e1c613cd9" -d '{"events": [{"name": "network-changed", "server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:20:11.416618 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59768) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:11.484388 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a014aebd-6280-4d95-a32e-bb81c4c129f3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event updated for resources: {'Port': ['ID=57415158-968f-4f63-9c5f-eba02f4dd725,revision_number=7']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:11.510820 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:20:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8237f288-6a95-4b90-af9f-439427a980bf x-openstack-request-id: req-8237f288-6a95-4b90-af9f-439427a980bf {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:20:11.511527 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:20:11.512227 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-8237f288-6a95-4b90-af9f-439427a980bf {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:20:11.512821 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725', 'status': 'completed', 'code': 200} Nov 24 11:20:11.518393 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['57415158-968f-4f63-9c5f-eba02f4dd725'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:20:11.552586 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a1e85f0d-d896-4165-8407-c5c88e2eb508 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.569057 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b13289-7cab-49ad-b6ec-3b9e1c613cd9 req-afd59fc7-6caf-4226-904a-15801c41f933 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:11.574356 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90b13289-7cab-49ad-b6ec-3b9e1c613cd9 req-afd59fc7-6caf-4226-904a-15801c41f933 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=41b5f46d34ad4033a154a9afabe2091f&device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 1099 time: 0.0587809 Nov 24 11:20:11.644669 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 4309383c-b778-44aa-bd64-d0a29f77fb4d details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:20:11.645135 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a1e85f0d-d896-4165-8407-c5c88e2eb508 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.686221 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d4884e8-7e3f-4f78-9023-18309298f19b req-c951eae1-c8d5-45e3-8224-da63fadc6d68 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:11.687987 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7d4884e8-7e3f-4f78-9023-18309298f19b req-c951eae1-c8d5-45e3-8224-da63fadc6d68 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0979207 Nov 24 11:20:11.737804 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b13289-7cab-49ad-b6ec-3b9e1c613cd9 req-1876fb8d-a070-4aa2-b17d-35ca0c7a96f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:11.739704 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90b13289-7cab-49ad-b6ec-3b9e1c613cd9 req-1876fb8d-a070-4aa2-b17d-35ca0c7a96f9 service neutron] 10.222.0.86 "GET /v2.0/networks?id=c3a531f2-bfe9-4a80-8b71-ad7f35944879 HTTP/1.1" status: 200 len: 917 time: 0.1572003 Nov 24 11:20:11.773682 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7d4884e8-7e3f-4f78-9023-18309298f19b req-20026122-4588-43fb-a864-89543ded3b1b tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0732493 Nov 24 11:20:11.834585 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90b13289-7cab-49ad-b6ec-3b9e1c613cd9 req-9cecc6ad-096a-456b-bf27-8d3f3f51fd75 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=57415158-968f-4f63-9c5f-eba02f4dd725 HTTP/1.1" status: 200 len: 1002 time: 0.0818241 Nov 24 11:20:11.878313 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 4309383c-b778-44aa-bd64-d0a29f77fb4d, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:11.889220 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b13289-7cab-49ad-b6ec-3b9e1c613cd9 req-08b1fe8b-c559-4731-986e-7077dd290117 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:11.891981 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90b13289-7cab-49ad-b6ec-3b9e1c613cd9 req-08b1fe8b-c559-4731-986e-7077dd290117 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=08393eb4-7b60-4211-937a-8e0724891dbc HTTP/1.1" status: 200 len: 854 time: 0.0486615 Nov 24 11:20:11.894661 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-7b927d69-3cff-44ad-95b0-be5265527720 None None] Provisioning complete for port 57415158-968f-4f63-9c5f-eba02f4dd725 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:20:11.895028 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-7b927d69-3cff-44ad-95b0-be5265527720 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.899695 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'port_id': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'mac_address': 'fa:16:3e:2f:0e:bb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1239, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:20:11.911108 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a1e85f0d-d896-4165-8407-c5c88e2eb508 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.914632 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-a1e85f0d-d896-4165-8407-c5c88e2eb508 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.918402 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-a1e85f0d-d896-4165-8407-c5c88e2eb508 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "DELETE /v2.0/security-groups/3447b729-9871-4ac1-9faf-bf8884defce7 HTTP/1.1" status: 204 len: 168 time: 0.4981067 Nov 24 11:20:11.919156 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59784) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:11.975815 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b13289-7cab-49ad-b6ec-3b9e1c613cd9 req-42116f02-e63b-4d5b-9e79-7645ce0c4cb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:11.981613 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1e85f0d-d896-4165-8407-c5c88e2eb508 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3447b729-9871-4ac1-9faf-bf8884defce7,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:11.984335 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:11.989830 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90b13289-7cab-49ad-b6ec-3b9e1c613cd9 req-42116f02-e63b-4d5b-9e79-7645ce0c4cb3 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=c3a531f2-bfe9-4a80-8b71-ad7f35944879&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0830441 Nov 24 11:20:12.031403 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4309383c-b778-44aa-bd64-d0a29f77fb4d {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:20:12.077147 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 4309383c-b778-44aa-bd64-d0a29f77fb4d, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:12.113291 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90b13289-7cab-49ad-b6ec-3b9e1c613cd9 req-47790fcc-8117-4cc4-834b-a96689d0edc3 service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1201160 Nov 24 11:20:12.137431 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Deleting port d07b8672-13e9-44a3-874b-8468b25e89d2 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:20:12.137887 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:12.151800 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:12.212173 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=4309383c-b778-44aa-bd64-d0a29f77fb4d,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:12.220569 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:12.220900 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:12.228020 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-90b13289-7cab-49ad-b6ec-3b9e1c613cd9 req-0f238087-c22e-4103-8e33-54988067723e service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1060019 Nov 24 11:20:12.233989 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Calling delete_port for d07b8672-13e9-44a3-874b-8468b25e89d2 owned by network:floatingip {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:20:12.424625 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['4309383c-b778-44aa-bd64-d0a29f77fb4d'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:20:12.462889 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:12.488521 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:12.516886 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event deleted for resources: {'Port': ['ID=d07b8672-13e9-44a3-874b-8468b25e89d2,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:12.584402 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks [] for floatingip, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:12.584878 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.l3_db [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Floating IP 8aaa7db5-e2b2-4460-a574-914da19b8aea disassociated (deleted). External IP: 172.27.3.144, port: 57415158-968f-4f63-9c5f-eba02f4dd725. Nov 24 11:20:13.073941 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Router 0d8adae3-0d48-4940-84b4-9800d498d230 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:20:13.084390 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ffe359-a262-440a-8a39-4f001a4d5516 req-25e97ffa-ef04-4f7d-937b-a13cb609ac1d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:13.086417 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f0ffe359-a262-440a-8a39-4f001a4d5516 req-25e97ffa-ef04-4f7d-937b-a13cb609ac1d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 944 time: 0.0749648 Nov 24 11:20:13.207121 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f0ffe359-a262-440a-8a39-4f001a4d5516 req-cc88bbd4-0a79-4529-bb87-a0403d1dda6f tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1128311 Nov 24 11:20:13.232490 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:20:13.236855 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:13.243275 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcc6f017-58e2-448e-936c-50d4a243ecee None None] Sync routers for ids ['0d8adae3-0d48-4940-84b4-9800d498d230'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:20:13.253384 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcc6f017-58e2-448e-936c-50d4a243ecee None None] Routers {'0d8adae3-0d48-4940-84b4-9800d498d230'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:20:13.254001 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-fcc6f017-58e2-448e-936c-50d4a243ecee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:20:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['0d8adae3-0d48-4940-84b4-9800d498d230'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:13.263669 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-7146ca52-dc31-4ed6-a3ee-edeef182d39d tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "DELETE /v2.0/floatingips/8aaa7db5-e2b2-4460-a574-914da19b8aea HTTP/1.1" status: 204 len: 168 time: 1.3396523 Nov 24 11:20:13.373823 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-fcc6f017-58e2-448e-936c-50d4a243ecee None None] Set router 0d8adae3-0d48-4940-84b4-9800d498d230 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:20:13.514359 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:20:13.516785 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-401a198f-d1bf-4bb6-96a0-668bcc987bfa" -d '{"events": [{"name": "network-changed", "server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:20:13.556211 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:20:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9fed5f8a-b6eb-4eba-8993-afd99c3b06e1 x-openstack-request-id: req-9fed5f8a-b6eb-4eba-8993-afd99c3b06e1 {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:20:13.556502 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:20:13.556752 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-9fed5f8a-b6eb-4eba-8993-afd99c3b06e1 {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:20:13.557185 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725', 'status': 'completed', 'code': 200} Nov 24 11:20:13.651733 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 4309383c-b778-44aa-bd64-d0a29f77fb4d up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:20:13.729745 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-401a198f-d1bf-4bb6-96a0-668bcc987bfa req-f9ae2999-4947-46d7-8f98-e47cf0d8d394 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:13.731206 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-401a198f-d1bf-4bb6-96a0-668bcc987bfa req-f9ae2999-4947-46d7-8f98-e47cf0d8d394 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=41b5f46d34ad4033a154a9afabe2091f&device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 1099 time: 0.1506753 Nov 24 11:20:13.747640 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-fcc6f017-58e2-448e-936c-50d4a243ecee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:17:33Z', 'revision_number': 4, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3c193dd0-ad65-44b5-b059-da55dd5857b0', 'name': '', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'mac_address': 'fa:16:3e:0f:1e:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:33Z', 'updated_at': '2021-11-24T11:17:38Z', 'revision_number': 5, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'subnets': [{'id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:13.787785 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcc6f017-58e2-448e-936c-50d4a243ecee None None] Checking router: 0d8adae3-0d48-4940-84b4-9800d498d230 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:20:13.797979 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 4309383c-b778-44aa-bd64-d0a29f77fb4d completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:20:13.801012 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fcc6f017-58e2-448e-936c-50d4a243ecee None None] Routers {'0d8adae3-0d48-4940-84b4-9800d498d230'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:20:13.801617 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-fcc6f017-58e2-448e-936c-50d4a243ecee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:20:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['0d8adae3-0d48-4940-84b4-9800d498d230'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:13.805856 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 4309383c-b778-44aa-bd64-d0a29f77fb4d triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:20:13.805856 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:13.844305 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-401a198f-d1bf-4bb6-96a0-668bcc987bfa req-257345b0-62ee-42c3-9fe3-51a2669c23d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:13.845776 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-401a198f-d1bf-4bb6-96a0-668bcc987bfa req-257345b0-62ee-42c3-9fe3-51a2669c23d5 service neutron] 10.222.0.86 "GET /v2.0/networks?id=c3a531f2-bfe9-4a80-8b71-ad7f35944879 HTTP/1.1" status: 200 len: 917 time: 0.1070983 Nov 24 11:20:13.889182 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-401a198f-d1bf-4bb6-96a0-668bcc987bfa req-0c38d20d-673b-4c33-b005-13b8f0b86078 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=57415158-968f-4f63-9c5f-eba02f4dd725 HTTP/1.1" status: 200 len: 217 time: 0.0349746 Nov 24 11:20:13.942821 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-401a198f-d1bf-4bb6-96a0-668bcc987bfa req-f171bca2-d05b-4fbb-9082-462faede3710 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:13.944286 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-401a198f-d1bf-4bb6-96a0-668bcc987bfa req-f171bca2-d05b-4fbb-9082-462faede3710 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=08393eb4-7b60-4211-937a-8e0724891dbc HTTP/1.1" status: 200 len: 854 time: 0.0470719 Nov 24 11:20:13.963702 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-fcc6f017-58e2-448e-936c-50d4a243ecee None None] Set router 0d8adae3-0d48-4940-84b4-9800d498d230 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:20:13.991521 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-401a198f-d1bf-4bb6-96a0-668bcc987bfa req-342b0e0d-c2c8-4e9f-b94b-6d86728e6f79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:13.993666 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-401a198f-d1bf-4bb6-96a0-668bcc987bfa req-342b0e0d-c2c8-4e9f-b94b-6d86728e6f79 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=c3a531f2-bfe9-4a80-8b71-ad7f35944879&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0423734 Nov 24 11:20:14.029640 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:14.087080 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-401a198f-d1bf-4bb6-96a0-668bcc987bfa req-94f5a985-3cc2-4d93-80db-b9a848da09a8 service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834987 Nov 24 11:20:14.087494 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:14.099930 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:20:14.102757 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1763fbfd-98c8-47e8-af5b-4a07ece97237" -d '{"events": [{"server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "name": "network-vif-plugged", "status": "completed", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:20:14.148123 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 4309383c-b778-44aa-bd64-d0a29f77fb4d, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:14.173480 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:20:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a1c4b13-b9f8-49d5-b07d-6fca92ce5869 x-openstack-request-id: req-8a1c4b13-b9f8-49d5-b07d-6fca92ce5869 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:20:14.179446 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "name": "network-vif-plugged", "status": "completed", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:20:14.179446 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-8a1c4b13-b9f8-49d5-b07d-6fca92ce5869 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:20:14.179446 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'code': 200} Nov 24 11:20:14.192317 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-401a198f-d1bf-4bb6-96a0-668bcc987bfa req-6b503ad1-4c23-4ed2-97fd-d58c82b5a2d5 service neutron] 10.222.0.86 "GET /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0964632 Nov 24 11:20:14.224646 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:14.283677 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=4309383c-b778-44aa-bd64-d0a29f77fb4d,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:14.289304 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-fcc6f017-58e2-448e-936c-50d4a243ecee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:17:33Z', 'revision_number': 4, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3c193dd0-ad65-44b5-b059-da55dd5857b0', 'name': '', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'mac_address': 'fa:16:3e:0f:1e:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:33Z', 'updated_at': '2021-11-24T11:17:38Z', 'revision_number': 5, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'subnets': [{'id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:14.322543 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fcc6f017-58e2-448e-936c-50d4a243ecee None None] The sync data for ids ['0d8adae3-0d48-4940-84b4-9800d498d230'] in dv-cinder-804035-18-iscsi is: [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:17:33Z', 'revision_number': 4, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3c193dd0-ad65-44b5-b059-da55dd5857b0', 'name': '', 'network_id': 'c3a531f2-bfe9-4a80-8b71-ad7f35944879', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'mac_address': 'fa:16:3e:0f:1e:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_interface', 'standard_attr_id': 363, 'fixed_ips': [{'subnet_id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:33Z', 'updated_at': '2021-11-24T11:17:38Z', 'revision_number': 5, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'subnets': [{'id': '08393eb4-7b60-4211-937a-8e0724891dbc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:20:14.334648 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad4da66d-0e6e-42f5-a301-fd5862218819 req-1f638429-1108-47b5-ad92-005698627c3e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:14.338601 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ad4da66d-0e6e-42f5-a301-fd5862218819 req-1f638429-1108-47b5-ad92-005698627c3e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0524845 Nov 24 11:20:14.417883 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ad4da66d-0e6e-42f5-a301-fd5862218819 req-b6bb039f-f2e5-4b6e-b0a6-9c8c55a959c0 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0740178 Nov 24 11:20:14.570189 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d684f294-e7cd-4a73-98e6-abd5d6a68e2d req-13776a5e-8235-424b-83ff-b46a6a1f2b2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:14.571895 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d684f294-e7cd-4a73-98e6-abd5d6a68e2d req-13776a5e-8235-424b-83ff-b46a6a1f2b2d service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 1098 time: 0.0425696 Nov 24 11:20:14.602722 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d656281c-aac4-4b2a-ba89-a5ad3114d2ed None None] New status for floating IP 8aaa7db5-e2b2-4460-a574-914da19b8aea: DOWN {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:20:14.626852 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d684f294-e7cd-4a73-98e6-abd5d6a68e2d req-dbad12ac-18bb-428d-99ce-5adeb3a8591d service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450544 Nov 24 11:20:14.819807 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:15.542525 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e29aa93c-1dcf-4949-90b7-0fbbf258c45c req-cb01d09e-c344-4817-9449-c52a784f2e78 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:15.543922 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e29aa93c-1dcf-4949-90b7-0fbbf258c45c req-cb01d09e-c344-4817-9449-c52a784f2e78 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0493648 Nov 24 11:20:15.591552 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e29aa93c-1dcf-4949-90b7-0fbbf258c45c req-0b41339d-2e51-493a-982b-bdef72678181 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418837 Nov 24 11:20:18.305852 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1709107e-8749-44c6-91e2-e1afe3657af2 req-013d6a20-9790-4c76-93b6-2b238380b4d1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:18.307318 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1709107e-8749-44c6-91e2-e1afe3657af2 req-013d6a20-9790-4c76-93b6-2b238380b4d1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0500662 Nov 24 11:20:18.355487 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1709107e-8749-44c6-91e2-e1afe3657af2 req-bc13ba56-3f65-498e-941b-c181e7bb7249 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422761 Nov 24 11:20:19.506106 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f824dd-306c-4575-9b52-dc54d0daf140 req-3d1044ff-cf2b-4b7a-a6eb-cb4b2d048efa tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:19.512332 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-72f824dd-306c-4575-9b52-dc54d0daf140 req-3d1044ff-cf2b-4b7a-a6eb-cb4b2d048efa tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0568385 Nov 24 11:20:19.569113 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-72f824dd-306c-4575-9b52-dc54d0daf140 req-29c894d0-3703-459f-929d-ae7100deb660 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0538247 Nov 24 11:20:19.605867 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b1e57a-49c0-4bff-9141-bb93ce60f0a4 req-909a55c2-db2c-4e6f-b8af-a339be552b33 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:19.607371 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f8b1e57a-49c0-4bff-9141-bb93ce60f0a4 req-909a55c2-db2c-4e6f-b8af-a339be552b33 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 946 time: 0.0604508 Nov 24 11:20:19.678094 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f8b1e57a-49c0-4bff-9141-bb93ce60f0a4 req-47783318-5187-4c68-b8d2-1830664c10e3 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645261 Nov 24 11:20:19.699371 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28606f36-cad5-459e-9579-c5a0d95d4fe5 req-004b6ae1-6a2a-48a8-970d-4203bd03be74 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:19.700852 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-28606f36-cad5-459e-9579-c5a0d95d4fe5 req-004b6ae1-6a2a-48a8-970d-4203bd03be74 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0619714 Nov 24 11:20:19.754589 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-28606f36-cad5-459e-9579-c5a0d95d4fe5 req-76a77daf-89eb-4c64-9748-3a983610220c tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479877 Nov 24 11:20:19.776971 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59892) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:19.916103 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f7a06315-d3b3-4a39-a6d0-6521ceb214f3 tempest-TestShelveInstance-955831899 tempest-TestShelveInstance-955831899-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:19.917586 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-f7a06315-d3b3-4a39-a6d0-6521ceb214f3 tempest-TestShelveInstance-955831899 tempest-TestShelveInstance-955831899-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 1093 time: 0.1396596 Nov 24 11:20:19.920477 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 59896) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:19.924616 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Request body: {'floatingip': {'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'port_id': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'fixed_ip_address': '172.20.0.5'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:20:20.006602 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for floatingip, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:20.103862 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:20.205917 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Allocated IP 172.27.3.101 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/ca24e93b-012b-4295-8eef-7fe5ea88cacd) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:20:20.307762 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:20.418392 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:20.459388 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:20:20.462233 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:20:20.465619 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:20:20.471090 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event updated for resources: {'Port': ['ID=ca24e93b-012b-4295-8eef-7fe5ea88cacd,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:20.815538 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:20.936141 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:21.087903 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for port, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:21.145043 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8699083'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:21.211069 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event updated for resources: {'Port': ['ID=ca24e93b-012b-4295-8eef-7fe5ea88cacd,revision_number=2']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:21.223485 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:21.324540 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.l3_db [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Floating IP 6191c1d8-3c71-4a1d-bd3b-0ff3b9486c4b associated. External IP: 172.27.3.101, port: 4309383c-b778-44aa-bd64-d0a29f77fb4d. Nov 24 11:20:21.529508 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Router 98c34a41-9cdb-48f6-bfa4-2ed94016563f has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:20:21.635991 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:20:21.645184 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-397923c1-482b-423d-a3a5-28f9f8ad370f None None] Sync routers for ids ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:20:21.655521 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-397923c1-482b-423d-a3a5-28f9f8ad370f None None] Routers {'98c34a41-9cdb-48f6-bfa4-2ed94016563f'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:20:21.656127 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-397923c1-482b-423d-a3a5-28f9f8ad370f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:20:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:21.713652 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:21.740102 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-8ab674d4-89ea-49fc-8e29-a9e14147b40d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8186431 Nov 24 11:20:21.740674 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:20:21.742911 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cebe108d-8679-4f44-b8c5-7998f8ccea69" -d '{"events": [{"name": "network-changed", "server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:20:21.762025 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-397923c1-482b-423d-a3a5-28f9f8ad370f None None] Set router 98c34a41-9cdb-48f6-bfa4-2ed94016563f gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:20:21.984109 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-397923c1-482b-423d-a3a5-28f9f8ad370f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:26Z', 'revision_number': 4, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '6191c1d8-3c71-4a1d-bd3b-0ff3b9486c4b', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'floating_ip_address': '172.27.3.101', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'port_id': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 539, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'mac_address': 'fa:16:3e:2f:0e:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19240268-0de5-4be0-9b3e-745da67e3b50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:20:20Z', 'updated_at': '2021-11-24T11:20:20Z', 'revision_number': 0, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d', 'name': '', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'mac_address': 'fa:16:3e:5e:d7:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:25Z', 'updated_at': '2021-11-24T11:19:30Z', 'revision_number': 5, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'subnets': [{'id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:22.009706 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-397923c1-482b-423d-a3a5-28f9f8ad370f None None] Checking router: 98c34a41-9cdb-48f6-bfa4-2ed94016563f for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:20:22.017581 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-397923c1-482b-423d-a3a5-28f9f8ad370f None None] Routers {'98c34a41-9cdb-48f6-bfa4-2ed94016563f'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:20:22.018156 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-397923c1-482b-423d-a3a5-28f9f8ad370f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:20:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:22.119047 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-397923c1-482b-423d-a3a5-28f9f8ad370f None None] Set router 98c34a41-9cdb-48f6-bfa4-2ed94016563f gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:20:22.451076 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-397923c1-482b-423d-a3a5-28f9f8ad370f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:26Z', 'revision_number': 4, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '6191c1d8-3c71-4a1d-bd3b-0ff3b9486c4b', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'floating_ip_address': '172.27.3.101', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'port_id': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 539, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'mac_address': 'fa:16:3e:2f:0e:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19240268-0de5-4be0-9b3e-745da67e3b50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:20:20Z', 'updated_at': '2021-11-24T11:20:20Z', 'revision_number': 0, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d', 'name': '', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'mac_address': 'fa:16:3e:5e:d7:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:25Z', 'updated_at': '2021-11-24T11:19:30Z', 'revision_number': 5, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'subnets': [{'id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:22.480063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-397923c1-482b-423d-a3a5-28f9f8ad370f None None] The sync data for ids ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'] in dv-cinder-804035-18-iscsi is: [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:26Z', 'revision_number': 4, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '6191c1d8-3c71-4a1d-bd3b-0ff3b9486c4b', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'floating_ip_address': '172.27.3.101', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'port_id': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 539, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'mac_address': 'fa:16:3e:2f:0e:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '19240268-0de5-4be0-9b3e-745da67e3b50', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:20:20Z', 'updated_at': '2021-11-24T11:20:20Z', 'revision_number': 0, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d', 'name': '', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'mac_address': 'fa:16:3e:5e:d7:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:25Z', 'updated_at': '2021-11-24T11:19:30Z', 'revision_number': 5, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'subnets': [{'id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:20:22.664310 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d23d534b-3dc6-405d-9a09-b32e2221d00a None None] New status for floating IP 6191c1d8-3c71-4a1d-bd3b-0ff3b9486c4b: ACTIVE {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:20:22.844080 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-262b0b8b-63ea-41ec-b401-e483a380e861 req-877bffc4-f201-42db-abd8-c651fd03c7f9 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:22.845640 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-262b0b8b-63ea-41ec-b401-e483a380e861 req-877bffc4-f201-42db-abd8-c651fd03c7f9 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 946 time: 0.0502496 Nov 24 11:20:22.900400 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-262b0b8b-63ea-41ec-b401-e483a380e861 req-ab16c87c-0a79-4fb0-ad5e-e6ee343e7979 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473113 Nov 24 11:20:22.926012 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:20:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-52c23c4f-dddf-4d20-a618-5886fdf14523 x-openstack-request-id: req-52c23c4f-dddf-4d20-a618-5886fdf14523 {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:20:22.926295 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:20:22.926543 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-52c23c4f-dddf-4d20-a618-5886fdf14523 {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:20:22.927147 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'status': 'completed', 'code': 200} Nov 24 11:20:23.001796 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebe108d-8679-4f44-b8c5-7998f8ccea69 req-2d88d173-6724-48cb-9984-696aca7a138b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:23.003172 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cebe108d-8679-4f44-b8c5-7998f8ccea69 req-2d88d173-6724-48cb-9984-696aca7a138b service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=89e9b1abd4814b03ae8c95c5918bef03&device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 1098 time: 0.0448015 Nov 24 11:20:23.099746 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebe108d-8679-4f44-b8c5-7998f8ccea69 req-49295ec0-4323-48d4-a725-45174b3164bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:23.101184 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cebe108d-8679-4f44-b8c5-7998f8ccea69 req-49295ec0-4323-48d4-a725-45174b3164bb service neutron] 10.222.0.86 "GET /v2.0/networks?id=6b81a015-9685-4892-8d78-2a713f48dc53 HTTP/1.1" status: 200 len: 911 time: 0.0858815 Nov 24 11:20:23.173931 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cebe108d-8679-4f44-b8c5-7998f8ccea69 req-801793bb-e2d4-4e51-a639-5ec566992371 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d HTTP/1.1" status: 200 len: 1001 time: 0.0619345 Nov 24 11:20:23.224618 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebe108d-8679-4f44-b8c5-7998f8ccea69 req-6f4e5693-75f1-4071-9d88-40e0cf558be9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:23.226046 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cebe108d-8679-4f44-b8c5-7998f8ccea69 req-6f4e5693-75f1-4071-9d88-40e0cf558be9 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c HTTP/1.1" status: 200 len: 848 time: 0.0445256 Nov 24 11:20:23.271892 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cebe108d-8679-4f44-b8c5-7998f8ccea69 req-9151ce0e-d3ac-4c08-b80a-b1f2a9cc2b2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:23.273289 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cebe108d-8679-4f44-b8c5-7998f8ccea69 req-9151ce0e-d3ac-4c08-b80a-b1f2a9cc2b2c service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b81a015-9685-4892-8d78-2a713f48dc53&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0394063 Nov 24 11:20:23.365980 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cebe108d-8679-4f44-b8c5-7998f8ccea69 req-32f92e01-1ddc-4c8c-8eb5-70a48a6c1bbf service neutron] 10.222.0.86 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840590 Nov 24 11:20:23.456996 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-cebe108d-8679-4f44-b8c5-7998f8ccea69 req-d41848e9-71a4-4852-9435-5e09c1850634 service neutron] 10.222.0.86 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809138 Nov 24 11:20:24.021108 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751cd0ae-cd64-45e8-b485-999952b9c192 req-38f62d24-f051-4904-8f38-3fd560336089 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:24.022594 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-751cd0ae-cd64-45e8-b485-999952b9c192 req-38f62d24-f051-4904-8f38-3fd560336089 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 946 time: 0.0507777 Nov 24 11:20:24.069995 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-751cd0ae-cd64-45e8-b485-999952b9c192 req-b9acfe45-4003-40a2-b3a8-f4d51c9b0ad2 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/security-groups?id=77852028-b8f9-4fe3-8362-a7373cc59d6b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414746 Nov 24 11:20:24.091863 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-713638b3-bd43-4f6b-8d20-449ea5c7224b req-f7ae3463-b1c2-4e38-b06f-9098cd05a750 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:24.093337 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-713638b3-bd43-4f6b-8d20-449ea5c7224b req-f7ae3463-b1c2-4e38-b06f-9098cd05a750 tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.86 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 946 time: 0.0534649 Nov 24 11:20:24.187642 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-713638b3-bd43-4f6b-8d20-449ea5c7224b req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Deleting port 57415158-968f-4f63-9c5f-eba02f4dd725 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:20:24.187901 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-713638b3-bd43-4f6b-8d20-449ea5c7224b req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:24.277978 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-713638b3-bd43-4f6b-8d20-449ea5c7224b req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] For port 57415158-968f-4f63-9c5f-eba02f4dd725, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=57415158-968f-4f63-9c5f-eba02f4dd725,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:24.278334 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-713638b3-bd43-4f6b-8d20-449ea5c7224b req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:24.289790 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-713638b3-bd43-4f6b-8d20-449ea5c7224b req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Calling delete_port for 57415158-968f-4f63-9c5f-eba02f4dd725 owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:20:24.476498 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-713638b3-bd43-4f6b-8d20-449ea5c7224b req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:24.489649 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['57415158-968f-4f63-9c5f-eba02f4dd725'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:20:24.508579 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Pushing event deleted for resources: {'Port': ['ID=57415158-968f-4f63-9c5f-eba02f4dd725,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:24.520584 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:24.520930 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:24.521277 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:24.521617 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:24.521942 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:24.522281 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:24.522593 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:24.522916 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:24.523256 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:24.523598 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:24.523922 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:24.524245 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:24.558592 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-713638b3-bd43-4f6b-8d20-449ea5c7224b req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] No DVR routers for this DVR port 57415158-968f-4f63-9c5f-eba02f4dd725 on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:20:24.560984 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-713638b3-bd43-4f6b-8d20-449ea5c7224b req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:24.564286 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-713638b3-bd43-4f6b-8d20-449ea5c7224b req-c98e01ec-def4-47fc-b872-ea75255860fb tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.86 "DELETE /v2.0/ports/57415158-968f-4f63-9c5f-eba02f4dd725 HTTP/1.1" status: 204 len: 173 time: 0.4609656 Nov 24 11:20:24.566594 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'name': 'network-vif-deleted', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:20:24.566926 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-177ca424-9747-42d2-a415-20716a2ca438" -d '{"events": [{"server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "name": "network-vif-deleted", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:20:24.658620 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:20:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a4b0802c-0895-4b7e-9c58-6dd4f83597ed x-openstack-request-id: req-a4b0802c-0895-4b7e-9c58-6dd4f83597ed {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:20:24.658886 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "dec8021d-af19-41f7-ad1b-27e4dd98c201", "name": "network-vif-deleted", "tag": "57415158-968f-4f63-9c5f-eba02f4dd725", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:20:24.659144 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-a4b0802c-0895-4b7e-9c58-6dd4f83597ed {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:20:24.659564 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'dec8021d-af19-41f7-ad1b-27e4dd98c201', 'name': 'network-vif-deleted', 'tag': '57415158-968f-4f63-9c5f-eba02f4dd725', 'status': 'completed', 'code': 200} Nov 24 11:20:25.176631 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-338a70c7-56cc-4e55-b05c-a3edd87d15a8 req-e22ad7af-fb3e-4ed2-8f95-d70916b3569a tempest-TestMinimumBasicScenario-1412473457 tempest-TestMinimumBasicScenario-1412473457-project] 10.222.0.76 "GET /v2.0/ports?device_id=dec8021d-af19-41f7-ad1b-27e4dd98c201 HTTP/1.1" status: 200 len: 210 time: 0.0272155 Nov 24 11:20:27.711234 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 57415158-968f-4f63-9c5f-eba02f4dd725 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:20:27.732429 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 57415158-968f-4f63-9c5f-eba02f4dd725 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:20:27.732774 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 57415158-968f-4f63-9c5f-eba02f4dd725 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:20:27.842811 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60010) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:28.194452 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3a36e43c-fb14-49be-a399-e0d35b0348b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1009613'] for router_interface, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:28.452114 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-3a36e43c-fb14-49be-a399-e0d35b0348b2 admin admin] Deleting port 3c193dd0-ad65-44b5-b059-da55dd5857b0 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:20:28.452442 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3a36e43c-fb14-49be-a399-e0d35b0348b2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:28.530514 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-3a36e43c-fb14-49be-a399-e0d35b0348b2 admin admin] For port 3c193dd0-ad65-44b5-b059-da55dd5857b0, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=3c193dd0-ad65-44b5-b059-da55dd5857b0,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:28.530899 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3a36e43c-fb14-49be-a399-e0d35b0348b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:28.544189 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-3a36e43c-fb14-49be-a399-e0d35b0348b2 admin admin] Calling delete_port for 3c193dd0-ad65-44b5-b059-da55dd5857b0 owned by network:router_interface {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:20:28.800872 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3a36e43c-fb14-49be-a399-e0d35b0348b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:28.826649 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a36e43c-fb14-49be-a399-e0d35b0348b2 admin admin] Pushing event deleted for resources: {'Port': ['ID=3c193dd0-ad65-44b5-b059-da55dd5857b0,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:29.261945 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3a36e43c-fb14-49be-a399-e0d35b0348b2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-637217', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1011037'] for router_interface, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:29.469787 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a36e43c-fb14-49be-a399-e0d35b0348b2 admin admin] Router 0d8adae3-0d48-4940-84b4-9800d498d230 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:20:29.573190 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a36e43c-fb14-49be-a399-e0d35b0348b2 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:20:29.578067 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-3a36e43c-fb14-49be-a399-e0d35b0348b2 admin admin] 10.222.0.76 "PUT /v2.0/routers/0d8adae3-0d48-4940-84b4-9800d498d230/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7340686 Nov 24 11:20:29.580540 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60032) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:29.584847 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c6e59a3-7b9a-4af8-a123-40ad4a3c492f None None] Sync routers for ids ['0d8adae3-0d48-4940-84b4-9800d498d230'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:20:29.595732 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c6e59a3-7b9a-4af8-a123-40ad4a3c492f None None] Routers {'0d8adae3-0d48-4940-84b4-9800d498d230'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:20:29.596349 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-8c6e59a3-7b9a-4af8-a123-40ad4a3c492f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:20:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['0d8adae3-0d48-4940-84b4-9800d498d230'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:29.684694 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Publish callbacks [] for router, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:29.701864 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-8c6e59a3-7b9a-4af8-a123-40ad4a3c492f None None] Set router 0d8adae3-0d48-4940-84b4-9800d498d230 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:20:29.789182 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:29.887149 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Deleting port 0b6945a0-371d-4113-8209-5fa0406ef613 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:20:29.887813 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:29.887959 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-8c6e59a3-7b9a-4af8-a123-40ad4a3c492f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59'}], 'enable_snat': True}, 'gw_port_id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:20:28Z', 'revision_number': 5, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port': {'id': '0b6945a0-371d-4113-8209-5fa0406ef613', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:57:71:87', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'device_owner': 'network:router_gateway', 'standard_attr_id': 362, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.59', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:31Z', 'updated_at': '2021-11-24T11:17:35Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:29.914310 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c6e59a3-7b9a-4af8-a123-40ad4a3c492f None None] Checking router: 0d8adae3-0d48-4940-84b4-9800d498d230 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:20:29.923355 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c6e59a3-7b9a-4af8-a123-40ad4a3c492f None None] Routers {'0d8adae3-0d48-4940-84b4-9800d498d230'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:20:29.923970 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-8c6e59a3-7b9a-4af8-a123-40ad4a3c492f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:20:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['0d8adae3-0d48-4940-84b4-9800d498d230'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:29.971875 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] For port 0b6945a0-371d-4113-8209-5fa0406ef613, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=0b6945a0-371d-4113-8209-5fa0406ef613,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:29.972257 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:29.984537 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Calling delete_port for 0b6945a0-371d-4113-8209-5fa0406ef613 owned by network:router_gateway {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:20:30.012420 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-8c6e59a3-7b9a-4af8-a123-40ad4a3c492f None None] Set router 0d8adae3-0d48-4940-84b4-9800d498d230 gateway port host: None {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:20:30.066988 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-8c6e59a3-7b9a-4af8-a123-40ad4a3c492f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:20:29Z', 'revision_number': 6, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port_host': None}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:30.094247 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c6e59a3-7b9a-4af8-a123-40ad4a3c492f None None] The sync data for ids ['0d8adae3-0d48-4940-84b4-9800d498d230'] in dv-cinder-804035-18-iscsi is: [{'id': '0d8adae3-0d48-4940-84b4-9800d498d230', 'name': 'tempest-TestMinimumBasicScenario-1890588899-router', 'tenant_id': '41b5f46d34ad4033a154a9afabe2091f', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:30Z', 'updated_at': '2021-11-24T11:20:29Z', 'revision_number': 6, 'project_id': '41b5f46d34ad4033a154a9afabe2091f', 'gw_port_host': None}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:20:30.208332 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:30.237983 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Pushing event deleted for resources: {'Port': ['ID=0b6945a0-371d-4113-8209-5fa0406ef613,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:30.300445 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-942710'] for router_gateway, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:30.389373 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1010955', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-663'] for router, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:30.391459 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:30.482461 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1010962'] for router, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:30.483010 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0d8adae3-0d48-4940-84b4-9800d498d230 {{(pid=103244) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 11:20:30.487261 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] Publish callbacks [] for router, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:30.488499 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-6060143d-8732-442d-be3c-73081304e84a admin admin] 10.222.0.76 "DELETE /v2.0/routers/0d8adae3-0d48-4940-84b4-9800d498d230 HTTP/1.1" status: 204 len: 168 time: 0.9070201 Nov 24 11:20:30.490931 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60038) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:30.540869 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_v2 [None req-6c15eeca-827b-4cc6-bcbf-763f8fb07ff0 admin admin] Deleting subnet 08393eb4-7b60-4211-937a-8e0724891dbc {{(pid=103244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:20:30.544052 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6c15eeca-827b-4cc6-bcbf-763f8fb07ff0 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:30.582840 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6c15eeca-827b-4cc6-bcbf-763f8fb07ff0 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4161249'] for subnet, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:30.688961 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6c15eeca-827b-4cc6-bcbf-763f8fb07ff0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:30.813219 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6c15eeca-827b-4cc6-bcbf-763f8fb07ff0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8699037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8480512'] for subnet, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:30.841385 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c15eeca-827b-4cc6-bcbf-763f8fb07ff0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=08393eb4-7b60-4211-937a-8e0724891dbc,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:30.845832 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6c15eeca-827b-4cc6-bcbf-763f8fb07ff0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:30.849092 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-6c15eeca-827b-4cc6-bcbf-763f8fb07ff0 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/08393eb4-7b60-4211-937a-8e0724891dbc HTTP/1.1" status: 204 len: 168 time: 0.3572042 Nov 24 11:20:30.851518 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60040) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:30.852149 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36fab414-e3d6-417f-a998-81d13da341af None None] Network c3a531f2-bfe9-4a80-8b71-ad7f35944879 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:20:30.924885 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:30.983647 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Deleting port 837493e4-10b5-44b3-a94e-2a49a078d343 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:20:30.984005 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:31.054849 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] DHCP port deletion for c3a531f2-bfe9-4a80-8b71-ad7f35944879 request from dv-cinder-804035-18-iscsi {{(pid=103245) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 11:20:31.076298 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] For port 837493e4-10b5-44b3-a94e-2a49a078d343, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=837493e4-10b5-44b3-a94e-2a49a078d343,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:31.076682 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:31.077250 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:20:31.091517 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Calling delete_port for 837493e4-10b5-44b3-a94e-2a49a078d343 owned by network:dhcp {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:20:31.116566 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Deleting port 837493e4-10b5-44b3-a94e-2a49a078d343 {{(pid=103245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:20:31.116942 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:31.133796 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 0b6945a0-371d-4113-8209-5fa0406ef613 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:20:31.164813 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 0b6945a0-371d-4113-8209-5fa0406ef613 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:20:31.165217 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 0b6945a0-371d-4113-8209-5fa0406ef613 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:20:31.166135 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 3c193dd0-ad65-44b5-b059-da55dd5857b0 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:20:31.219942 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 3c193dd0-ad65-44b5-b059-da55dd5857b0 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:20:31.219942 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 3c193dd0-ad65-44b5-b059-da55dd5857b0 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:20:31.219942 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 837493e4-10b5-44b3-a94e-2a49a078d343 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:20:31.237947 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:31.262172 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] For port 837493e4-10b5-44b3-a94e-2a49a078d343, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=837493e4-10b5-44b3-a94e-2a49a078d343,segment=NetworkSegment(71343ab0-4290-4798-8417-9a4b559b66e3),segment_id=71343ab0-4290-4798-8417-9a4b559b66e3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:31.262581 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:31.267489 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Pushing event deleted for resources: {'Port': ['ID=837493e4-10b5-44b3-a94e-2a49a078d343,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:31.271239 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] No DVR routers for this DVR port 837493e4-10b5-44b3-a94e-2a49a078d343 on host dv-cinder-804035-18-iscsi {{(pid=103244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:20:31.282392 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Calling delete_port for 837493e4-10b5-44b3-a94e-2a49a078d343 owned by network:dhcp {{(pid=103245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:20:31.295632 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No active binding found for port 837493e4-10b5-44b3-a94e-2a49a078d343 {{(pid=103245) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Nov 24 11:20:31.296198 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 837493e4-10b5-44b3-a94e-2a49a078d343 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:20:31.348504 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:31.368568 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c3a531f2-bfe9-4a80-8b71-ad7f35944879']}} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:31.378204 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '71343ab0-4290-4798-8417-9a4b559b66e3') {'for_net_delete': True} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:31.378543 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '71343ab0-4290-4798-8417-9a4b559b66e3') {} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:31.388561 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4161272'] for segment, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:31.402552 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:31.406168 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:31.408774 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Releasing vlan 1225 on physical network physnet1 to pool {{(pid=103244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:20:31.409206 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8699699'] for segment, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: Traceback (most recent call last): Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: timer() Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: cb(*args, **kw) Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: return func(*args, **kwargs) Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: self._notify() Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: self.callback(batched_events) Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: event.method(event) Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: return f(self, *a, **k) Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._get(url).json() Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: return self.request(url, 'GET', **kwargs) Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:20:31.411754 dv-cinder-804035-18-iscsi neutron-server[103244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:20:31.431437 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Pushing event deleted for resources: {'Port': ['ID=837493e4-10b5-44b3-a94e-2a49a078d343,revision_number=None']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:31.439847 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] No DVR routers for this DVR port 837493e4-10b5-44b3-a94e-2a49a078d343 on host dv-cinder-804035-18-iscsi {{(pid=103245) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:20:31.442504 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:31.442857 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:31.443214 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:31.443569 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:31.443908 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:31.444238 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:31.444569 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:31.444899 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:31.445226 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:31.445553 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:31.445878 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:31.446202 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94794653-a0ef-46bd-8045-283224c404e5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:31.538252 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:31.545579 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:31.548798 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] 10.222.0.76 "DELETE /v2.0/networks/c3a531f2-bfe9-4a80-8b71-ad7f35944879 HTTP/1.1" status: 204 len: 168 time: 0.6963780 Nov 24 11:20:31.551734 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60046) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:31.558453 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d75e4fe-0e4b-4e88-9af8-7cefa60e5be5 admin admin] Pushing event deleted for resources: {'Network': ['ID=c3a531f2-bfe9-4a80-8b71-ad7f35944879,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:31.958332 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a9ecc074-4fe4-4fd3-bd50-62128e742f28 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1009613'] for router_interface, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:32.490512 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-a9ecc074-4fe4-4fd3-bd50-62128e742f28 admin admin] Deleting port f51f8128-1b30-41e7-8ef8-25605ddf1809 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:20:32.490768 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a9ecc074-4fe4-4fd3-bd50-62128e742f28 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:32.567138 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [None req-a9ecc074-4fe4-4fd3-bd50-62128e742f28 admin admin] For port f51f8128-1b30-41e7-8ef8-25605ddf1809, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=f51f8128-1b30-41e7-8ef8-25605ddf1809,segment=NetworkSegment(fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3),segment_id=fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:32.567866 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a9ecc074-4fe4-4fd3-bd50-62128e742f28 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:32.579800 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-a9ecc074-4fe4-4fd3-bd50-62128e742f28 admin admin] Calling delete_port for f51f8128-1b30-41e7-8ef8-25605ddf1809 owned by network:router_interface {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:20:32.823960 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a9ecc074-4fe4-4fd3-bd50-62128e742f28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:32.855431 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9ecc074-4fe4-4fd3-bd50-62128e742f28 admin admin] Pushing event deleted for resources: {'Port': ['ID=f51f8128-1b30-41e7-8ef8-25605ddf1809,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:33.090368 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-a9ecc074-4fe4-4fd3-bd50-62128e742f28 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-637217', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1011037'] for router_interface, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:33.311384 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9ecc074-4fe4-4fd3-bd50-62128e742f28 admin admin] Router da3d2828-5da1-45d7-82a4-de474b0ce982 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:20:33.418758 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9ecc074-4fe4-4fd3-bd50-62128e742f28 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:20:33.423846 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-a9ecc074-4fe4-4fd3-bd50-62128e742f28 admin admin] 10.222.0.76 "PUT /v2.0/routers/da3d2828-5da1-45d7-82a4-de474b0ce982/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8710403 Nov 24 11:20:33.426602 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60072) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:33.429332 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec4d62e8-d424-406f-8088-52433cfa0723 None None] Sync routers for ids ['da3d2828-5da1-45d7-82a4-de474b0ce982'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:20:33.439717 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec4d62e8-d424-406f-8088-52433cfa0723 None None] Routers {'da3d2828-5da1-45d7-82a4-de474b0ce982'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:20:33.440336 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-ec4d62e8-d424-406f-8088-52433cfa0723 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:20:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['da3d2828-5da1-45d7-82a4-de474b0ce982'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:33.538456 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Publish callbacks [] for router, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:33.550491 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-ec4d62e8-d424-406f-8088-52433cfa0723 None None] Set router da3d2828-5da1-45d7-82a4-de474b0ce982 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:20:33.647989 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:33.752073 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-ec4d62e8-d424-406f-8088-52433cfa0723 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'name': 'tempest-TestMinimumBasicScenario-1938436293-router', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52'}], 'enable_snat': True}, 'gw_port_id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:20:32Z', 'revision_number': 5, 'project_id': 'c0d223d26f5146fc9e583ac067c520d4', 'gw_port': {'id': '9e5c8471-8e07-4442-afbe-a820f59bc7fe', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:4b:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.52', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:17:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:33.752919 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32434c7e-a86f-4420-a4ed-5daf5b40010b req-0af3bdb3-4e92-490c-a5c1-535050ce54fd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:33.754442 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-32434c7e-a86f-4420-a4ed-5daf5b40010b req-0af3bdb3-4e92-490c-a5c1-535050ce54fd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0494299 Nov 24 11:20:33.781676 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec4d62e8-d424-406f-8088-52433cfa0723 None None] Checking router: da3d2828-5da1-45d7-82a4-de474b0ce982 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:20:33.794683 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec4d62e8-d424-406f-8088-52433cfa0723 None None] Routers {'da3d2828-5da1-45d7-82a4-de474b0ce982'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:20:33.795522 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-ec4d62e8-d424-406f-8088-52433cfa0723 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:20:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['da3d2828-5da1-45d7-82a4-de474b0ce982'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:33.833153 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-32434c7e-a86f-4420-a4ed-5daf5b40010b req-59a984bd-404f-4670-b7b0-ab94cf04f5af tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0561373 Nov 24 11:20:33.839098 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Deleting port 9e5c8471-8e07-4442-afbe-a820f59bc7fe {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:20:33.842374 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:33.938543 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] For port 9e5c8471-8e07-4442-afbe-a820f59bc7fe, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9e5c8471-8e07-4442-afbe-a820f59bc7fe,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:33.938930 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:33.952425 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Calling delete_port for 9e5c8471-8e07-4442-afbe-a820f59bc7fe owned by network:router_gateway {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:20:33.973040 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-ec4d62e8-d424-406f-8088-52433cfa0723 None None] Set router da3d2828-5da1-45d7-82a4-de474b0ce982 gateway port host: None {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:20:34.031202 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-ec4d62e8-d424-406f-8088-52433cfa0723 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'name': 'tempest-TestMinimumBasicScenario-1938436293-router', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:20:33Z', 'revision_number': 6, 'project_id': 'c0d223d26f5146fc9e583ac067c520d4', 'gw_port_host': None}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:34.058155 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec4d62e8-d424-406f-8088-52433cfa0723 None None] The sync data for ids ['da3d2828-5da1-45d7-82a4-de474b0ce982'] in dv-cinder-804035-18-iscsi is: [{'id': 'da3d2828-5da1-45d7-82a4-de474b0ce982', 'name': 'tempest-TestMinimumBasicScenario-1938436293-router', 'tenant_id': 'c0d223d26f5146fc9e583ac067c520d4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:17:37Z', 'updated_at': '2021-11-24T11:20:33Z', 'revision_number': 6, 'project_id': 'c0d223d26f5146fc9e583ac067c520d4', 'gw_port_host': None}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:20:34.185305 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:34.212633 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Pushing event deleted for resources: {'Port': ['ID=9e5c8471-8e07-4442-afbe-a820f59bc7fe,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:34.276046 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-942710'] for router_gateway, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:34.364271 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1010955', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-663'] for router, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:34.366311 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:34.476932 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1010962'] for router, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:34.477525 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Fanout notify agent at l3_agent the message router_deleted on router da3d2828-5da1-45d7-82a4-de474b0ce982 {{(pid=103244) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 11:20:34.482691 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] Publish callbacks [] for router, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:34.483912 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-d2a8864e-9609-4fd3-b4f9-aea694e54b50 admin admin] 10.222.0.76 "DELETE /v2.0/routers/da3d2828-5da1-45d7-82a4-de474b0ce982 HTTP/1.1" status: 204 len: 168 time: 1.0562882 Nov 24 11:20:34.486333 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60088) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:34.534716 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_v2 [None req-b9823b45-7643-4799-b57f-cdd29bdafcb4 admin admin] Deleting subnet bbb81453-3784-4f5f-894b-df2a2d1d7d9c {{(pid=103244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:20:34.537830 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b9823b45-7643-4799-b57f-cdd29bdafcb4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:34.574838 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b9823b45-7643-4799-b57f-cdd29bdafcb4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4161249'] for subnet, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:34.651710 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b9823b45-7643-4799-b57f-cdd29bdafcb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:34.768577 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b9823b45-7643-4799-b57f-cdd29bdafcb4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8699037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8480512'] for subnet, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:34.800641 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9823b45-7643-4799-b57f-cdd29bdafcb4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bbb81453-3784-4f5f-894b-df2a2d1d7d9c,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:34.802473 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b9823b45-7643-4799-b57f-cdd29bdafcb4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:34.805799 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-b9823b45-7643-4799-b57f-cdd29bdafcb4 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/bbb81453-3784-4f5f-894b-df2a2d1d7d9c HTTP/1.1" status: 204 len: 168 time: 0.3185234 Nov 24 11:20:34.807862 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-54161bb8-273d-4da9-b427-009d77ae9186 None None] Network 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:20:34.808757 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60094) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:34.880517 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:34.984030 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c5a687-ab52-4031-a231-552d472093f9 req-f60ffa5a-d05a-4610-bdc2-62d023e1ec55 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:34.985574 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a7c5a687-ab52-4031-a231-552d472093f9 req-f60ffa5a-d05a-4610-bdc2-62d023e1ec55 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0714977 Nov 24 11:20:34.989917 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Deleting port ca18f43d-c498-4734-82e7-7a402959f852 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:20:34.990252 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:35.011788 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bdd68c8f-e8b7-4db5-bf8d-ea9e2ac440c0 None None] DHCP port deletion for 005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 request from dv-cinder-804035-18-iscsi {{(pid=103245) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 11:20:35.066413 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-bdd68c8f-e8b7-4db5-bf8d-ea9e2ac440c0 None None] Deleting port ca18f43d-c498-4734-82e7-7a402959f852 {{(pid=103245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:20:35.066984 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-bdd68c8f-e8b7-4db5-bf8d-ea9e2ac440c0 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:35.081679 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] For port ca18f43d-c498-4734-82e7-7a402959f852, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=ca18f43d-c498-4734-82e7-7a402959f852,segment=NetworkSegment(fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3),segment_id=fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:35.082315 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:35.108091 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a7c5a687-ab52-4031-a231-552d472093f9 req-529620ef-6d6c-4199-a3d4-8940d49fe46c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1124725 Nov 24 11:20:35.113178 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Calling delete_port for ca18f43d-c498-4734-82e7-7a402959f852 owned by network:dhcp {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:20:35.144406 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9e5c8471-8e07-4442-afbe-a820f59bc7fe no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:20:35.173650 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 9e5c8471-8e07-4442-afbe-a820f59bc7fe {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:20:35.174016 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9e5c8471-8e07-4442-afbe-a820f59bc7fe not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:20:35.174418 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device f51f8128-1b30-41e7-8ef8-25605ddf1809 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:20:35.177101 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-bdd68c8f-e8b7-4db5-bf8d-ea9e2ac440c0 None None] For port ca18f43d-c498-4734-82e7-7a402959f852, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=ca18f43d-c498-4734-82e7-7a402959f852,segment=NetworkSegment(fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3),segment_id=fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:35.177495 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-bdd68c8f-e8b7-4db5-bf8d-ea9e2ac440c0 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:35.205499 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: f51f8128-1b30-41e7-8ef8-25605ddf1809 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:20:35.205499 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device f51f8128-1b30-41e7-8ef8-25605ddf1809 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:20:35.205499 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device ca18f43d-c498-4734-82e7-7a402959f852 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:20:35.210461 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-bdd68c8f-e8b7-4db5-bf8d-ea9e2ac440c0 None None] Calling delete_port for ca18f43d-c498-4734-82e7-7a402959f852 owned by network:dhcp {{(pid=103245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:20:35.270437 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:35.284623 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No active binding found for port ca18f43d-c498-4734-82e7-7a402959f852 {{(pid=103245) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:216}} Nov 24 11:20:35.285034 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device ca18f43d-c498-4734-82e7-7a402959f852 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:20:35.296650 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Pushing event deleted for resources: {'Port': ['ID=ca18f43d-c498-4734-82e7-7a402959f852,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:35.304223 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] No DVR routers for this DVR port ca18f43d-c498-4734-82e7-7a402959f852 on host dv-cinder-804035-18-iscsi {{(pid=103244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:20:35.323430 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-bdd68c8f-e8b7-4db5-bf8d-ea9e2ac440c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:35.348143 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdd68c8f-e8b7-4db5-bf8d-ea9e2ac440c0 None None] Pushing event deleted for resources: {'Port': ['ID=ca18f43d-c498-4734-82e7-7a402959f852,revision_number=None']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:35.355755 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdd68c8f-e8b7-4db5-bf8d-ea9e2ac440c0 None None] No DVR routers for this DVR port ca18f43d-c498-4734-82e7-7a402959f852 on host dv-cinder-804035-18-iscsi {{(pid=103245) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:20:35.382278 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:35.405581 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8']}} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:35.415679 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3') {'for_net_delete': True} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:35.415975 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fedb2ee8-5ced-48b2-a6da-e3ce50eea2d3') {} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:20:35.425737 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4161272'] for segment, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:35.439145 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:35.445017 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Releasing vlan 1232 on physical network physnet1 to pool {{(pid=103244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:20:35.445394 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8699699'] for segment, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: Traceback (most recent call last): Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: timer() Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: cb(*args, **kw) Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: return func(*args, **kwargs) Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: self._notify() Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: self.callback(batched_events) Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: event.method(event) Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: return f(self, *a, **k) Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._get(url).json() Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: return self.request(url, 'GET', **kwargs) Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:20:35.447599 dv-cinder-804035-18-iscsi neutron-server[103244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:20:35.545194 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:35.551518 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:35.554554 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] 10.222.0.76 "DELETE /v2.0/networks/005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8 HTTP/1.1" status: 204 len: 168 time: 0.7448802 Nov 24 11:20:35.564879 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62bd56db-8fae-424f-9ef8-2b6403282ad4 admin admin] Pushing event deleted for resources: {'Network': ['ID=005bb2ec-2aa8-404f-8fcd-291bfc7ac7e8,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:35.966072 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60112) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:36.009612 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-78a15bb3-448e-4380-a1ef-78e091c820de admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=41b5f46d34ad4033a154a9afabe2091f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0421126 Nov 24 11:20:36.011764 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60114) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:36.333492 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1000ef8d-e56f-4018-9232-0b7bdcf2784d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:36.342360 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3faf0294-47d8-44b0-8bb4-e0a0f3c243df req-60801c34-a83d-4fd4-a225-7e716b820730 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:36.343858 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3faf0294-47d8-44b0-8bb4-e0a0f3c243df req-60801c34-a83d-4fd4-a225-7e716b820730 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0749621 Nov 24 11:20:36.376535 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1000ef8d-e56f-4018-9232-0b7bdcf2784d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:36.425916 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3faf0294-47d8-44b0-8bb4-e0a0f3c243df req-03d0d59b-0930-4992-883b-b2ac37554f5d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0740290 Nov 24 11:20:36.528321 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1000ef8d-e56f-4018-9232-0b7bdcf2784d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:36.530961 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-1000ef8d-e56f-4018-9232-0b7bdcf2784d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:36.532114 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-1000ef8d-e56f-4018-9232-0b7bdcf2784d admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/77852028-b8f9-4fe3-8362-a7373cc59d6b HTTP/1.1" status: 204 len: 168 time: 0.5194573 Nov 24 11:20:36.539973 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1000ef8d-e56f-4018-9232-0b7bdcf2784d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=77852028-b8f9-4fe3-8362-a7373cc59d6b,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:37.190202 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60140) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:37.194230 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60142) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:37.238022 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-1f77757e-2257-40b8-94f0-306c9cf16be2 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=c0d223d26f5146fc9e583ac067c520d4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0426154 Nov 24 11:20:37.240562 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60146) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:37.288817 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:37.311186 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:37.390530 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-beef2a1e-9cf0-442c-bd5c-5434ef4b8475 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:37.459634 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:37.462363 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:37.466154 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/5161b1aa-973a-4166-b3f1-0fd10fd6de51 HTTP/1.1" status: 204 len: 168 time: 0.2222812 Nov 24 11:20:37.466542 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-beef2a1e-9cf0-442c-bd5c-5434ef4b8475 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:37.473499 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5161b1aa-973a-4166-b3f1-0fd10fd6de51,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:37.483108 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:37.483497 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:37.483842 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:37.484183 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:37.486243 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:37.486243 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:37.486243 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:37.486243 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:37.486243 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:37.486243 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:37.486910 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:37.486910 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68904d00-78a7-4a86-bf2b-f2815e1a99eb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:20:37.539899 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-beef2a1e-9cf0-442c-bd5c-5434ef4b8475 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:37.552369 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d925638-5c1c-40f5-9ac7-cf0d3bda809b req-d60b6e65-1fc7-4ee4-878f-8b907f4693c0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:37.553931 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3d925638-5c1c-40f5-9ac7-cf0d3bda809b req-d60b6e65-1fc7-4ee4-878f-8b907f4693c0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0485427 Nov 24 11:20:37.579904 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-beef2a1e-9cf0-442c-bd5c-5434ef4b8475 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=87a628dba6054a04968a6ad5f9e6a9eb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3885970 Nov 24 11:20:37.582885 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beef2a1e-9cf0-442c-bd5c-5434ef4b8475 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ff53499-c828-44f2-b69f-9ac98d45ffcc,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:37.586120 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60152) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:20:37.605999 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3d925638-5c1c-40f5-9ac7-cf0d3bda809b req-d2eee191-f3d9-4d05-ab1a-2dda0719d01a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448332 Nov 24 11:20:37.636476 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8f062ff0-55ea-47e4-8f8c-a58cd5a5ecd7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:37.657744 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8f062ff0-55ea-47e4-8f8c-a58cd5a5ecd7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:37.756944 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8f062ff0-55ea-47e4-8f8c-a58cd5a5ecd7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:37.759616 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8f062ff0-55ea-47e4-8f8c-a58cd5a5ecd7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:37.760872 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-8f062ff0-55ea-47e4-8f8c-a58cd5a5ecd7 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/1ff53499-c828-44f2-b69f-9ac98d45ffcc HTTP/1.1" status: 204 len: 168 time: 0.1738315 Nov 24 11:20:37.775457 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f062ff0-55ea-47e4-8f8c-a58cd5a5ecd7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ff53499-c828-44f2-b69f-9ac98d45ffcc,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:38.729687 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7410b244-b834-4714-b746-adb7589c4186 req-cfba4992-dc3a-433a-8aae-93a95d9ef79e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:38.731177 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7410b244-b834-4714-b746-adb7589c4186 req-cfba4992-dc3a-433a-8aae-93a95d9ef79e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0529258 Nov 24 11:20:38.739477 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4fa02a86-46dd-4399-a15d-61f7be3cff0f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:38.780312 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7410b244-b834-4714-b746-adb7589c4186 req-6ac66614-5a1f-40aa-88a6-3f2e7b100036 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429642 Nov 24 11:20:39.191079 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:39.899124 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c2d627c-a7ed-4691-aac4-692e1727dc30 req-4da8f98f-5edb-46ab-94f0-124dab07490c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:39.900644 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0c2d627c-a7ed-4691-aac4-692e1727dc30 req-4da8f98f-5edb-46ab-94f0-124dab07490c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0488417 Nov 24 11:20:39.946215 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0c2d627c-a7ed-4691-aac4-692e1727dc30 req-a665b4f7-534e-4474-840f-0dfd1f4801ed tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397143 Nov 24 11:20:41.065246 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0869dddb-ce87-444c-8247-2c6d19f41ba8 req-dcfe7caa-99e7-44a3-a187-76fb407adcf9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:41.066649 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0869dddb-ce87-444c-8247-2c6d19f41ba8 req-dcfe7caa-99e7-44a3-a187-76fb407adcf9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0493777 Nov 24 11:20:41.117791 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0869dddb-ce87-444c-8247-2c6d19f41ba8 req-48994210-e304-4c30-9823-033a47953dc3 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452223 Nov 24 11:20:41.173556 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f482c7d2-9903-4db4-8f57-d709dc3ad43e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:42.236072 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ca0fb5-39d8-472a-96a2-814fdb48bfa8 req-1fb893a9-30a7-4307-ba5f-bad281f90c06 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:42.237560 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-07ca0fb5-39d8-472a-96a2-814fdb48bfa8 req-1fb893a9-30a7-4307-ba5f-bad281f90c06 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0489349 Nov 24 11:20:42.286575 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-07ca0fb5-39d8-472a-96a2-814fdb48bfa8 req-9de49023-5b5e-4247-951f-c79e36c25068 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428488 Nov 24 11:20:42.442539 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:43.411887 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dda6cfa-fcd3-405d-8a6f-e89867fe5152 req-4c91bca0-db3e-4793-9bc5-4091f92c3449 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:43.413417 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9dda6cfa-fcd3-405d-8a6f-e89867fe5152 req-4c91bca0-db3e-4793-9bc5-4091f92c3449 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0497978 Nov 24 11:20:43.460484 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9dda6cfa-fcd3-405d-8a6f-e89867fe5152 req-59b0c9df-d05e-4898-938e-2d5f2c26e155 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411336 Nov 24 11:20:44.058655 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:44.583152 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbc81777-3b33-4b5d-97e5-98e0baf74909 req-72a8bdd4-2407-4d51-9413-5a0f4806816c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:44.584630 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fbc81777-3b33-4b5d-97e5-98e0baf74909 req-72a8bdd4-2407-4d51-9413-5a0f4806816c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0519054 Nov 24 11:20:44.631870 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fbc81777-3b33-4b5d-97e5-98e0baf74909 req-ca86dc65-f13b-4651-8a16-0ea6d3168f21 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407755 Nov 24 11:20:44.794619 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:45.753678 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a6c8921-0d8f-4bba-aace-e9f893bed51d req-750af35f-0706-4e2c-af34-4067074ca884 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:45.755143 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6a6c8921-0d8f-4bba-aace-e9f893bed51d req-750af35f-0706-4e2c-af34-4067074ca884 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0485189 Nov 24 11:20:45.802562 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6a6c8921-0d8f-4bba-aace-e9f893bed51d req-8c3fb517-b4f9-42ec-bf10-e18015f9fe89 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415697 Nov 24 11:20:46.293079 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99ed14d7-8b44-45c2-98b0-6d15ba385922 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:20:46.389662 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:46.401249 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'port_id': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'mac_address': 'fa:16:3e:35:03:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1229, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:20:46.441505 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:46.454489 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 99ed14d7-8b44-45c2-98b0-6d15ba385922 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:20:46.474150 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:46.539463 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:46.596104 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=99ed14d7-8b44-45c2-98b0-6d15ba385922,revision_number=6']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:46.638644 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['99ed14d7-8b44-45c2-98b0-6d15ba385922'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:20:46.929195 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12c40e99-4373-42fc-b326-b52d93b26888 req-6d74df62-8eec-4b3b-9684-6021dcde2295 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:46.930629 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-12c40e99-4373-42fc-b326-b52d93b26888 req-6d74df62-8eec-4b3b-9684-6021dcde2295 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 944 time: 0.0524013 Nov 24 11:20:46.980687 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-12c40e99-4373-42fc-b326-b52d93b26888 req-0cadec4c-996b-4ead-9e78-2cb8a52eebac tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439186 Nov 24 11:20:48.119885 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42fb42ab-b52d-484e-bfdf-d36fa4894b21 req-ba92c333-8712-44cb-ac10-430609f1afe0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:48.122237 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-42fb42ab-b52d-484e-bfdf-d36fa4894b21 req-ba92c333-8712-44cb-ac10-430609f1afe0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 944 time: 0.0648642 Nov 24 11:20:48.182860 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-42fb42ab-b52d-484e-bfdf-d36fa4894b21 req-58436c25-ef63-49fb-954a-7b91f02794e1 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0536745 Nov 24 11:20:48.290894 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99ed14d7-8b44-45c2-98b0-6d15ba385922 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:20:48.339600 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 99ed14d7-8b44-45c2-98b0-6d15ba385922 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:20:48.340596 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:48.428482 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:48.453213 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:20:48.456513 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-93926b2a-1cb5-484e-8353-c71fc1db3f40" -d '{"events": [{"server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "name": "network-vif-plugged", "status": "completed", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:20:48.473089 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:20:48.546040 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:20:48.637943 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=99ed14d7-8b44-45c2-98b0-6d15ba385922,revision_number=7']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:20:48.650424 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:20:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-735f6f6c-cdf6-40c1-bae3-292dff00556d x-openstack-request-id: req-735f6f6c-cdf6-40c1-bae3-292dff00556d {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:20:48.651119 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "name": "network-vif-plugged", "status": "completed", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:20:48.651423 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-735f6f6c-cdf6-40c1-bae3-292dff00556d {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:20:48.651812 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'code': 200} Nov 24 11:20:49.334452 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3269784b-7efa-4048-a505-18a333c16af8 req-563c760e-913d-4583-b4b8-965be313319b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:49.335975 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3269784b-7efa-4048-a505-18a333c16af8 req-563c760e-913d-4583-b4b8-965be313319b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0540745 Nov 24 11:20:49.390061 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3269784b-7efa-4048-a505-18a333c16af8 req-e02890bc-57aa-4697-8cdb-e217173b6b35 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474570 Nov 24 11:20:50.523167 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d534dc4-e031-4e86-a3aa-a38eda011d35 req-3d7648ed-5d7f-4454-a530-78dac5a97cdb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:50.526874 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3d534dc4-e031-4e86-a3aa-a38eda011d35 req-3d7648ed-5d7f-4454-a530-78dac5a97cdb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0576720 Nov 24 11:20:50.589561 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3d534dc4-e031-4e86-a3aa-a38eda011d35 req-cf291e18-4ac1-4a42-9335-498206008735 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0553229 Nov 24 11:20:51.738307 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f213ccd1-b664-4e42-b79f-9a14e5b934c7 req-fbd3f4c7-dec6-4a4a-aa7d-582b8c21e258 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:51.756852 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f213ccd1-b664-4e42-b79f-9a14e5b934c7 req-fbd3f4c7-dec6-4a4a-aa7d-582b8c21e258 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0833557 Nov 24 11:20:51.847038 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f213ccd1-b664-4e42-b79f-9a14e5b934c7 req-50725d54-7142-4494-9fb9-8bbcf919b54f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0888104 Nov 24 11:20:53.036124 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae4c3bab-aa31-46d4-a025-436d2322d371 req-38462b1c-ad8b-4f81-9344-6f96e92e28ac tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:53.038106 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ae4c3bab-aa31-46d4-a025-436d2322d371 req-38462b1c-ad8b-4f81-9344-6f96e92e28ac tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0657556 Nov 24 11:20:53.089025 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ae4c3bab-aa31-46d4-a025-436d2322d371 req-876aa211-18d9-4e39-9f58-547a41169d5a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438249 Nov 24 11:20:54.252333 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3194269c-3181-4683-ab9e-68a76322a173 req-dc8e0a75-f6e6-49be-b001-4f6e39118b60 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:54.253895 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3194269c-3181-4683-ab9e-68a76322a173 req-dc8e0a75-f6e6-49be-b001-4f6e39118b60 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0736992 Nov 24 11:20:54.309880 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3194269c-3181-4683-ab9e-68a76322a173 req-abbeb98b-9b2b-4204-aeb2-513ea6a84ab7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0491862 Nov 24 11:20:55.441997 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdabaa7e-c432-4d9e-a686-1be9374ee614 req-c9ad3ff7-6852-405b-a861-24f21ba656f4 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:55.444296 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cdabaa7e-c432-4d9e-a686-1be9374ee614 req-c9ad3ff7-6852-405b-a861-24f21ba656f4 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0540946 Nov 24 11:20:55.503901 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cdabaa7e-c432-4d9e-a686-1be9374ee614 req-92995115-698b-49d9-94de-7d97ffb31fde tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0528915 Nov 24 11:20:56.632243 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0a32d9c-d8cc-4145-b077-0a18abbc2134 req-deeb4c72-fe22-4354-999b-09d3015a9dbb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:56.633905 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c0a32d9c-d8cc-4145-b077-0a18abbc2134 req-deeb4c72-fe22-4354-999b-09d3015a9dbb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0533617 Nov 24 11:20:56.681454 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c0a32d9c-d8cc-4145-b077-0a18abbc2134 req-7bbd2a51-9a2a-4534-b127-53bc07db7987 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418861 Nov 24 11:20:57.804858 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa5d0995-d459-4d3e-8511-893105820b13 req-03b261d2-1eb8-49ab-a503-daf05f5d74b5 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:57.806334 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-aa5d0995-d459-4d3e-8511-893105820b13 req-03b261d2-1eb8-49ab-a503-daf05f5d74b5 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0511141 Nov 24 11:20:57.853898 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-aa5d0995-d459-4d3e-8511-893105820b13 req-6c8f3f13-0d0a-489f-986c-d21595d4a77b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415618 Nov 24 11:20:58.437805 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd97c14d-c7a6-495e-8351-025b8c13f93f req-8b3c3308-73c4-4ec9-b00d-a78d051298f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:58.439849 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-bd97c14d-c7a6-495e-8351-025b8c13f93f req-8b3c3308-73c4-4ec9-b00d-a78d051298f9 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 1098 time: 0.0416336 Nov 24 11:20:58.527793 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd97c14d-c7a6-495e-8351-025b8c13f93f req-90c14a4c-cb0a-4a4a-8b69-b569cb2c798f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:58.529268 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-bd97c14d-c7a6-495e-8351-025b8c13f93f req-90c14a4c-cb0a-4a4a-8b69-b569cb2c798f service neutron] 10.222.0.86 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 919 time: 0.0820539 Nov 24 11:20:58.598011 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-bd97c14d-c7a6-495e-8351-025b8c13f93f req-43c7fd90-fd12-4fcf-9e5b-b9284bf90f95 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922 HTTP/1.1" status: 200 len: 1000 time: 0.0599625 Nov 24 11:20:58.648267 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd97c14d-c7a6-495e-8351-025b8c13f93f req-16089e2d-a162-4eef-9b73-f06651d1ad46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:58.649575 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-bd97c14d-c7a6-495e-8351-025b8c13f93f req-16089e2d-a162-4eef-9b73-f06651d1ad46 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=5eae2e87-935a-45b7-89da-586ce04ad644 HTTP/1.1" status: 200 len: 856 time: 0.0434008 Nov 24 11:20:58.696428 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd97c14d-c7a6-495e-8351-025b8c13f93f req-dc68c7ce-7ce3-4cf8-addb-6d8ae1bc1c69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:58.697845 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-bd97c14d-c7a6-495e-8351-025b8c13f93f req-dc68c7ce-7ce3-4cf8-addb-6d8ae1bc1c69 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=76fcee22-81e5-4608-a546-3b68c56c5ac7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0395267 Nov 24 11:20:58.790090 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-bd97c14d-c7a6-495e-8351-025b8c13f93f req-b45d28df-9e48-4f50-82db-ab7941303071 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838165 Nov 24 11:20:58.881893 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-bd97c14d-c7a6-495e-8351-025b8c13f93f req-b40b01ec-2ccb-45e0-92ad-5a86b45cfc64 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842228 Nov 24 11:20:58.978726 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c364128-dfe8-45ff-ab3b-4c125029a4e8 req-803da5c5-4ed8-4a7c-be73-bc2f457b1c5f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:20:58.980247 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9c364128-dfe8-45ff-ab3b-4c125029a4e8 req-803da5c5-4ed8-4a7c-be73-bc2f457b1c5f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0550113 Nov 24 11:20:59.027130 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9c364128-dfe8-45ff-ab3b-4c125029a4e8 req-f8cfc33a-92c6-4fc9-834c-a87c0f491290 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402286 Nov 24 11:21:00.147503 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de2dae3b-3f2a-4ed4-99f5-5c9fe1aae63a req-6170983d-8459-4916-89ae-3d2a07da8772 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:00.148948 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-de2dae3b-3f2a-4ed4-99f5-5c9fe1aae63a req-6170983d-8459-4916-89ae-3d2a07da8772 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0476682 Nov 24 11:21:00.194991 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-de2dae3b-3f2a-4ed4-99f5-5c9fe1aae63a req-56811e8a-00db-4e0b-992f-4d33adf94a96 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0402927 Nov 24 11:21:01.319991 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd09ff95-9fc0-486f-81e9-fc7f99354d88 req-de0e6b59-6ff2-4d3a-a4d8-f08cf756949d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:01.321374 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fd09ff95-9fc0-486f-81e9-fc7f99354d88 req-de0e6b59-6ff2-4d3a-a4d8-f08cf756949d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 945 time: 0.0535748 Nov 24 11:21:01.369234 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fd09ff95-9fc0-486f-81e9-fc7f99354d88 req-d8fc43ba-10c5-4d1c-919c-a6c1edb8fda5 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415840 Nov 24 11:21:02.337353 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99ed14d7-8b44-45c2-98b0-6d15ba385922 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:21:02.419039 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:02.442624 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:21:02.444844 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7137622d-e556-476d-bf87-623ff6434c7d" -d '{"events": [{"server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "name": "network-vif-unplugged", "status": "completed", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:21:02.458361 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:21:02.476530 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Wed, 24 Nov 2021 11:21:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5cc88b9a-f774-43ff-acef-0cb484daa64b x-openstack-request-id: req-5cc88b9a-f774-43ff-acef-0cb484daa64b {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:21:02.476827 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "name": "network-vif-unplugged", "status": "failed", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922", "code": 422}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:21:02.477082 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-5cc88b9a-f774-43ff-acef-0cb484daa64b {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:21:02.477496 dv-cinder-804035-18-iscsi neutron-server[103245]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'code': 422} returned with failed status Nov 24 11:21:02.563176 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:02.610729 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=99ed14d7-8b44-45c2-98b0-6d15ba385922,revision_number=8']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:03.309625 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [req-05961cb0-b6a3-41a6-8c82-73a3d6f00986 req-4862b677-885b-4ac8-be9a-bae1e84e4029 service neutron] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:21:03.310671 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-05961cb0-b6a3-41a6-8c82-73a3d6f00986 req-4862b677-885b-4ac8-be9a-bae1e84e4029 service neutron] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0974007 Nov 24 11:21:03.601316 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655003fd-baa8-4d0d-8708-51d530c80064 req-ce5e6057-5bba-4429-96ee-bd7fd3ce9a75 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:03.602832 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-655003fd-baa8-4d0d-8708-51d530c80064 req-ce5e6057-5bba-4429-96ee-bd7fd3ce9a75 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0518107 Nov 24 11:21:03.653088 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-655003fd-baa8-4d0d-8708-51d530c80064 req-2e8fc0a6-0359-4aff-91dc-8a549e9d17e0 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434475 Nov 24 11:21:04.027115 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60386) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:04.114002 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-0315a157-e74b-459b-abb8-c9076dd101b1 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0856962 Nov 24 11:21:04.123083 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-22aaf4e5-b382-4373-80f0-05e43372cec4 service neutron] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103243) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:21:04.124715 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-22aaf4e5-b382-4373-80f0-05e43372cec4 service neutron] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0057030 Nov 24 11:21:04.772878 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6a7519d-5258-4042-87d1-21164aa0ab26 req-ec08c335-2160-48f0-8671-359c3e2a0edd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:04.774390 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b6a7519d-5258-4042-87d1-21164aa0ab26 req-ec08c335-2160-48f0-8671-359c3e2a0edd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0482535 Nov 24 11:21:04.828955 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b6a7519d-5258-4042-87d1-21164aa0ab26 req-b2d8dd1f-1a5f-4354-9436-dd7f5b1769fe tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0473218 Nov 24 11:21:05.638143 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-1ddb80d8-d89b-4a4e-8f3d-9e05f95cda09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:05.639764 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-1ddb80d8-d89b-4a4e-8f3d-9e05f95cda09 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e&tenant_id=70ea7b83799640618db2c87847a8ecea HTTP/1.1" status: 200 len: 1096 time: 0.0409629 Nov 24 11:21:05.700823 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-a3c0b83f-9e39-4900-be5e-eec905c0f363 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:05.702590 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-a3c0b83f-9e39-4900-be5e-eec905c0f363 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 1096 time: 0.0395081 Nov 24 11:21:05.795091 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-41263e3f-8636-4d98-87c0-c59b9d0e76e3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:05.796646 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-41263e3f-8636-4d98-87c0-c59b9d0e76e3 service neutron] 10.222.0.86 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 919 time: 0.0866599 Nov 24 11:21:05.860702 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-27b16856-f8cb-4356-a0e4-5bb1ed2a3a95 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922 HTTP/1.1" status: 200 len: 998 time: 0.0565722 Nov 24 11:21:05.914243 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-c817a847-2355-49d4-8401-b20f93da0135 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:05.915672 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-c817a847-2355-49d4-8401-b20f93da0135 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=5eae2e87-935a-45b7-89da-586ce04ad644 HTTP/1.1" status: 200 len: 856 time: 0.0477841 Nov 24 11:21:05.950867 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a433a8cd-437b-490f-a224-cddf4e50f909 req-07ad27db-7a19-4b9a-a4b8-eaec9ecb4415 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:05.953057 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a433a8cd-437b-490f-a224-cddf4e50f909 req-07ad27db-7a19-4b9a-a4b8-eaec9ecb4415 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0488431 Nov 24 11:21:05.961720 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-985ca747-d96c-439b-bc38-5747a8d695c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:05.963322 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-985ca747-d96c-439b-bc38-5747a8d695c3 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=76fcee22-81e5-4608-a546-3b68c56c5ac7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0409791 Nov 24 11:21:06.000514 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a433a8cd-437b-490f-a224-cddf4e50f909 req-e0206a49-8363-4e1b-a0b2-256f2f7f8cc1 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410719 Nov 24 11:21:06.052220 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-8597de3d-7345-4703-a107-255ca3bfb198 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0813966 Nov 24 11:21:06.144463 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-2e6229c3-9c9f-45ff-9d11-7777b5997c62 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857906 Nov 24 11:21:07.127605 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b42fe82-30ff-4dda-932f-7eb10c55af03 req-5e0de1a8-f846-4872-9c4d-5674fd61c2d6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:07.129107 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6b42fe82-30ff-4dda-932f-7eb10c55af03 req-5e0de1a8-f846-4872-9c4d-5674fd61c2d6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0524220 Nov 24 11:21:07.182431 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6b42fe82-30ff-4dda-932f-7eb10c55af03 req-b3704fa6-7b8a-4155-ac14-4fec0269212c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469995 Nov 24 11:21:08.075857 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:21:08.315190 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb69f60e-8d87-42cc-bf92-ec55bf304c3f req-09e54a4b-8002-48ac-b358-f5e1d9b9533a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:08.323400 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cb69f60e-8d87-42cc-bf92-ec55bf304c3f req-09e54a4b-8002-48ac-b358-f5e1d9b9533a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0566444 Nov 24 11:21:08.379933 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cb69f60e-8d87-42cc-bf92-ec55bf304c3f req-8bcd3e8d-f7a2-4ff1-8dde-61d3f2b82bbd tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0548770 Nov 24 11:21:08.762295 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-9220f835-8588-4111-ad4a-ecad42d6ce67 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:09.208655 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:09.506815 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6caabe4b-2f9d-44b5-8db5-26961b8b0147 req-d2ab1afa-8cdd-4491-a163-fdc35102b44c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:09.509253 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6caabe4b-2f9d-44b5-8db5-26961b8b0147 req-d2ab1afa-8cdd-4491-a163-fdc35102b44c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0527902 Nov 24 11:21:09.555695 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6caabe4b-2f9d-44b5-8db5-26961b8b0147 req-f54c2cd2-360a-48ab-b9ae-ac88f70d401e tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411575 Nov 24 11:21:10.681499 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-223a8c73-873d-456a-a53d-ba21850f60e3 req-e5a3e62b-e226-4f23-9bb6-65e32f9119ac tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:10.682965 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-223a8c73-873d-456a-a53d-ba21850f60e3 req-e5a3e62b-e226-4f23-9bb6-65e32f9119ac tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0508339 Nov 24 11:21:10.740109 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-223a8c73-873d-456a-a53d-ba21850f60e3 req-de28778d-c656-4ef4-be60-7c5f63f11514 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0496311 Nov 24 11:21:11.191571 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-2baa2608-ecb4-4237-991c-d565517989ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:11.869074 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63097388-d62f-4b99-bc35-dde7f6b3f196 req-8beedf1f-877d-44b3-85aa-b935b0900e54 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:11.870565 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-63097388-d62f-4b99-bc35-dde7f6b3f196 req-8beedf1f-877d-44b3-85aa-b935b0900e54 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0535834 Nov 24 11:21:11.921791 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-63097388-d62f-4b99-bc35-dde7f6b3f196 req-4293cc12-d4ac-4598-9e92-da97d5cbcd27 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452881 Nov 24 11:21:12.482636 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:13.042996 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6f14c9f-52c5-4644-ae9f-27b4ee400b69 req-06d09a44-b7cb-48f0-a216-95497e96ab95 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:13.045533 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a6f14c9f-52c5-4644-ae9f-27b4ee400b69 req-06d09a44-b7cb-48f0-a216-95497e96ab95 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0504172 Nov 24 11:21:13.095571 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a6f14c9f-52c5-4644-ae9f-27b4ee400b69 req-acf07ab2-f5d2-49bb-b3d5-b8b69101aa9b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431380 Nov 24 11:21:14.046615 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:14.226517 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e8b6609-e028-4b8c-8dfd-c677ff7207db req-1eb74ee5-f677-4505-9c39-6e4ab4f3d21b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:14.228130 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2e8b6609-e028-4b8c-8dfd-c677ff7207db req-1eb74ee5-f677-4505-9c39-6e4ab4f3d21b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0545356 Nov 24 11:21:14.278426 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2e8b6609-e028-4b8c-8dfd-c677ff7207db req-a87b4fff-6f26-47da-aa67-cad341e197db tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441337 Nov 24 11:21:14.791080 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:15.407199 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a79a2b76-8a07-410f-b8e0-9da4f2c86b58 req-e2725a64-e84b-49f3-a575-c79f104e9468 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:15.409757 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a79a2b76-8a07-410f-b8e0-9da4f2c86b58 req-e2725a64-e84b-49f3-a575-c79f104e9468 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0521827 Nov 24 11:21:15.460113 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a79a2b76-8a07-410f-b8e0-9da4f2c86b58 req-b1405ec0-151a-4b83-825c-a9d28c420b89 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444534 Nov 24 11:21:16.589472 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f730dec-d864-4392-8686-01dc71bb8195 req-906a6550-539f-48ae-8e69-7e90918692a5 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:16.591035 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7f730dec-d864-4392-8686-01dc71bb8195 req-906a6550-539f-48ae-8e69-7e90918692a5 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0529788 Nov 24 11:21:16.640988 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7f730dec-d864-4392-8686-01dc71bb8195 req-9285390e-adb0-4057-8fb3-2173836a1fa3 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434766 Nov 24 11:21:17.147131 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48fac782-a739-4815-875c-21cf2c092991 req-6aa4d12b-12f9-491e-9dfd-78a8ae810c7e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:17.148739 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-48fac782-a739-4815-875c-21cf2c092991 req-6aa4d12b-12f9-491e-9dfd-78a8ae810c7e service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=70ea7b83799640618db2c87847a8ecea&device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 1096 time: 0.0402682 Nov 24 11:21:17.259001 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48fac782-a739-4815-875c-21cf2c092991 req-21dfc019-00be-4126-b64f-847e944b3211 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:17.260492 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-48fac782-a739-4815-875c-21cf2c092991 req-21dfc019-00be-4126-b64f-847e944b3211 service neutron] 10.222.0.86 "GET /v2.0/networks?id=76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 200 len: 919 time: 0.0870755 Nov 24 11:21:17.326542 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-48fac782-a739-4815-875c-21cf2c092991 req-4dbdeee9-d05b-4946-9bac-e5be465c7870 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922 HTTP/1.1" status: 200 len: 998 time: 0.0560400 Nov 24 11:21:17.380726 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48fac782-a739-4815-875c-21cf2c092991 req-aee1323a-4b4a-449e-88a6-da103b3014b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:17.382142 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-48fac782-a739-4815-875c-21cf2c092991 req-aee1323a-4b4a-449e-88a6-da103b3014b1 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=5eae2e87-935a-45b7-89da-586ce04ad644 HTTP/1.1" status: 200 len: 856 time: 0.0471058 Nov 24 11:21:17.426907 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48fac782-a739-4815-875c-21cf2c092991 req-2d26af79-eeae-444f-8ce1-02f68a7f3ffc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:17.428374 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-48fac782-a739-4815-875c-21cf2c092991 req-2d26af79-eeae-444f-8ce1-02f68a7f3ffc service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=76fcee22-81e5-4608-a546-3b68c56c5ac7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0381942 Nov 24 11:21:17.516580 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-48fac782-a739-4815-875c-21cf2c092991 req-88901ab5-969a-45e9-9da0-8d9c444bd3a9 service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0801947 Nov 24 11:21:17.615356 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-48fac782-a739-4815-875c-21cf2c092991 req-cf7e0883-8e30-4e92-ade3-de357c91f44b service neutron] 10.222.0.86 "GET /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0883234 Nov 24 11:21:17.764051 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b906d9-491e-4aed-920e-189302a1a181 req-66d2e8c0-642f-468b-9541-c6c0fdeba486 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:17.765530 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a6b906d9-491e-4aed-920e-189302a1a181 req-66d2e8c0-642f-468b-9541-c6c0fdeba486 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0516241 Nov 24 11:21:17.814258 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a6b906d9-491e-4aed-920e-189302a1a181 req-ec2593e4-ca1f-467a-afb0-11a025059315 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427856 Nov 24 11:21:18.932512 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b30e5b2-2e44-4e06-889f-2977bc37326e req-6397a414-22d9-457e-9d5e-80f787f7eb72 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:18.934518 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0b30e5b2-2e44-4e06-889f-2977bc37326e req-6397a414-22d9-457e-9d5e-80f787f7eb72 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0495355 Nov 24 11:21:18.986221 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0b30e5b2-2e44-4e06-889f-2977bc37326e req-9c9c8cef-e03d-4b58-af9c-712ec98e86ac tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456805 Nov 24 11:21:20.103489 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4848a26a-33e3-4d9b-896b-d07ee9cab3ad req-6f5e036b-1860-4e4e-8c1c-d0f485465f72 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:20.104928 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4848a26a-33e3-4d9b-896b-d07ee9cab3ad req-6f5e036b-1860-4e4e-8c1c-d0f485465f72 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 943 time: 0.0473526 Nov 24 11:21:20.150340 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4848a26a-33e3-4d9b-896b-d07ee9cab3ad req-0516f935-3f6f-4cd7-9ce9-9329deb4efd6 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396805 Nov 24 11:21:20.446074 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99ed14d7-8b44-45c2-98b0-6d15ba385922 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:21:20.544244 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:21:20.555095 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'port_id': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'mac_address': 'fa:16:3e:35:03:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1229, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:21:20.593152 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:20.610063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 99ed14d7-8b44-45c2-98b0-6d15ba385922 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:21:20.630382 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:21:20.711425 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:20.757782 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=99ed14d7-8b44-45c2-98b0-6d15ba385922,revision_number=9']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:20.940787 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['99ed14d7-8b44-45c2-98b0-6d15ba385922'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:21:21.272407 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7afa8fc-ccda-4d48-82c6-53ea43f3b485 req-1e099094-c5c7-42c1-ad1d-761f1a4a4d7c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:21.273887 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c7afa8fc-ccda-4d48-82c6-53ea43f3b485 req-1e099094-c5c7-42c1-ad1d-761f1a4a4d7c tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 944 time: 0.0480516 Nov 24 11:21:21.321215 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c7afa8fc-ccda-4d48-82c6-53ea43f3b485 req-a9b1df2e-1f35-4024-a5c9-1ee6b66bcde1 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414433 Nov 24 11:21:22.445724 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18582ff6-9eeb-4627-838f-3cc94b4308ee req-cf3f5fcf-5492-42e4-8ab6-307df318a241 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:22.446516 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99ed14d7-8b44-45c2-98b0-6d15ba385922 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:21:22.447256 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-18582ff6-9eeb-4627-838f-3cc94b4308ee req-cf3f5fcf-5492-42e4-8ab6-307df318a241 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 944 time: 0.0541027 Nov 24 11:21:22.496425 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 99ed14d7-8b44-45c2-98b0-6d15ba385922 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:21:22.496801 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:22.496932 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-18582ff6-9eeb-4627-838f-3cc94b4308ee req-048450ce-c588-4f8f-8be2-1110598abd09 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435627 Nov 24 11:21:22.575465 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:22.602833 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:21:22.605184 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-340adb12-d036-4525-8892-9653086f3f8e" -d '{"events": [{"server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "name": "network-vif-plugged", "status": "completed", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:21:22.623666 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:21:22.643856 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:21:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-57964c3e-5081-4ac7-bf76-385f81d03a04 x-openstack-request-id: req-57964c3e-5081-4ac7-bf76-385f81d03a04 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:21:22.644160 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "name": "network-vif-plugged", "status": "completed", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:21:22.647644 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-57964c3e-5081-4ac7-bf76-385f81d03a04 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:21:22.648525 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'code': 200} Nov 24 11:21:22.705720 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:22.753361 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=99ed14d7-8b44-45c2-98b0-6d15ba385922,revision_number=10']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:22.987061 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-908f5852-220e-4b3a-814a-b4ed9de55b1d req-301f2897-e2a1-4f32-8647-ad666d8c94d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:22.989134 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-908f5852-220e-4b3a-814a-b4ed9de55b1d req-301f2897-e2a1-4f32-8647-ad666d8c94d5 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 1099 time: 0.0397501 Nov 24 11:21:23.034082 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-908f5852-220e-4b3a-814a-b4ed9de55b1d req-cbc1770d-df3c-4ec2-939f-71912a6d1fc6 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0358610 Nov 24 11:21:23.617198 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5655124c-70ce-4661-b335-4a10c51759be req-3645e727-db4b-44cd-b3a4-a54389efe05d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:23.618638 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5655124c-70ce-4661-b335-4a10c51759be req-3645e727-db4b-44cd-b3a4-a54389efe05d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 946 time: 0.0487597 Nov 24 11:21:23.667788 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5655124c-70ce-4661-b335-4a10c51759be req-9916b6b8-32a0-42d5-b031-f1e57b5145af tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432503 Nov 24 11:21:24.433438 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2bf875c-a8cf-4f52-9604-8daae706e4a5 req-df7b5e40-7e32-49b1-b3e3-d3232f50877d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:24.435013 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f2bf875c-a8cf-4f52-9604-8daae706e4a5 req-df7b5e40-7e32-49b1-b3e3-d3232f50877d tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 946 time: 0.0583518 Nov 24 11:21:24.495392 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f2bf875c-a8cf-4f52-9604-8daae706e4a5 req-b69f847c-ad8a-4877-a7a9-bffffec6f4f4 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=bb1075fc-6aff-413d-aede-b8cd5b582753&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0544236 Nov 24 11:21:24.800344 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1844417e-3bc5-4881-b85a-671ad48a4515 req-7acf997b-21c1-401b-ad9e-956442733b64 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:24.802920 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1844417e-3bc5-4881-b85a-671ad48a4515 req-7acf997b-21c1-401b-ad9e-956442733b64 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 946 time: 0.0512831 Nov 24 11:21:24.850805 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1844417e-3bc5-4881-b85a-671ad48a4515 req-e1642dbe-7822-4d33-ba5c-ae674c514394 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418556 Nov 24 11:21:25.613218 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd237149-913b-473d-9f1f-40069efc8fbf req-710378a8-aedd-4b09-b38d-18d41dcf2fdb tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:25.614718 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd237149-913b-473d-9f1f-40069efc8fbf req-710378a8-aedd-4b09-b38d-18d41dcf2fdb tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 946 time: 0.0508406 Nov 24 11:21:25.661857 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd237149-913b-473d-9f1f-40069efc8fbf req-2d618e57-d506-40f6-83c9-783e9849a24e tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups?id=bb1075fc-6aff-413d-aede-b8cd5b582753&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407658 Nov 24 11:21:25.975144 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fa127e9-8e15-4439-a7a9-17946cdfda2f req-14e854e8-2929-44e7-b340-c38f1f590829 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:25.976627 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4fa127e9-8e15-4439-a7a9-17946cdfda2f req-14e854e8-2929-44e7-b340-c38f1f590829 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 946 time: 0.0514400 Nov 24 11:21:26.022233 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4fa127e9-8e15-4439-a7a9-17946cdfda2f req-8362699c-7008-49ca-87a6-e576f04d5b22 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399075 Nov 24 11:21:26.087217 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-a4b60d67-1382-4c36-b8d9-15856b52a39e tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:26.088896 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-a4b60d67-1382-4c36-b8d9-15856b52a39e tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.86 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 946 time: 0.0525296 Nov 24 11:21:26.176474 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Deleting port dafd269f-c5b4-41c6-b4f9-8869f4f91f59 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:21:26.176723 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:26.266513 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] For port dafd269f-c5b4-41c6-b4f9-8869f4f91f59, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=dafd269f-c5b4-41c6-b4f9-8869f4f91f59,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:21:26.273255 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:26.432742 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:26.433056 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:26.433372 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.l3_db [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Floating IP a7086214-f429-4a3a-899d-d76c53c3e20f disassociated. External IP: 172.27.3.50, port: dafd269f-c5b4-41c6-b4f9-8869f4f91f59. Nov 24 11:21:26.433710 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Calling delete_port for dafd269f-c5b4-41c6-b4f9-8869f4f91f59 owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:21:26.611819 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:26.640480 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event deleted for resources: {'Port': ['ID=dafd269f-c5b4-41c6-b4f9-8869f4f91f59,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:26.652325 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:26.652674 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:26.653062 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:26.653401 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:26.653732 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:26.654061 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:26.654389 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:26.654712 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:26.655037 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:26.655386 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:26.655705 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:26.656022 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:26.755540 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3a477e50-beaa-4a13-a1ee-73369aa9ab9b req-3132fb12-177f-489a-a349-cb4ce323c966 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 210 time: 0.0259867 Nov 24 11:21:26.775589 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:21:26.879716 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:21:26.889693 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9712e1f8-9bb3-4180-8dff-d99904a1a01a None None] Sync routers for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:21:26.899438 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9712e1f8-9bb3-4180-8dff-d99904a1a01a None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:21:26.900678 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-9712e1f8-9bb3-4180-8dff-d99904a1a01a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:21:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:26.919376 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] No DVR routers for this DVR port dafd269f-c5b4-41c6-b4f9-8869f4f91f59 on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:21:26.921921 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:26.925438 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7cb1e53f-cf92-4c3a-a982-a820121d6ea2 req-8a6500eb-eb3f-49ff-9528-c7f29d76f388 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.86 "DELETE /v2.0/ports/dafd269f-c5b4-41c6-b4f9-8869f4f91f59 HTTP/1.1" status: 204 len: 173 time: 0.8307638 Nov 24 11:21:26.925889 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'name': 'network-vif-deleted', 'tag': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:21:26.928126 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-67a74d1b-2d69-409f-8928-f67a03c7f733" -d '{"events": [{"server_uuid": "33c1d885-8008-4c47-95d3-dba8aaf38176", "name": "network-vif-deleted", "tag": "dafd269f-c5b4-41c6-b4f9-8869f4f91f59"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:21:26.972116 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:21:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6d39919-f431-4517-ab15-a3b9b4de659f x-openstack-request-id: req-b6d39919-f431-4517-ab15-a3b9b4de659f {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:21:26.972412 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "33c1d885-8008-4c47-95d3-dba8aaf38176", "name": "network-vif-deleted", "tag": "dafd269f-c5b4-41c6-b4f9-8869f4f91f59", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:21:26.972662 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-b6d39919-f431-4517-ab15-a3b9b4de659f {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:21:26.973055 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '33c1d885-8008-4c47-95d3-dba8aaf38176', 'name': 'network-vif-deleted', 'tag': 'dafd269f-c5b4-41c6-b4f9-8869f4f91f59', 'status': 'completed', 'code': 200} Nov 24 11:21:27.015167 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-9712e1f8-9bb3-4180-8dff-d99904a1a01a None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:21:27.227454 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-9712e1f8-9bb3-4180-8dff-d99904a1a01a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:11Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:27.256860 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9712e1f8-9bb3-4180-8dff-d99904a1a01a None None] Checking router: 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:21:27.265725 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9712e1f8-9bb3-4180-8dff-d99904a1a01a None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:21:27.266323 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-9712e1f8-9bb3-4180-8dff-d99904a1a01a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:21:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:27.374679 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-9712e1f8-9bb3-4180-8dff-d99904a1a01a None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:21:27.571316 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-9712e1f8-9bb3-4180-8dff-d99904a1a01a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:11Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:27.597906 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9712e1f8-9bb3-4180-8dff-d99904a1a01a None None] The sync data for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi is: [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:15:05Z', 'revision_number': 4, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '19717b1c-5b56-45d5-911e-2c1406e74b2b', 'name': '', 'network_id': 'd9d87ca8-7863-48a6-937c-ee712996776e', 'tenant_id': '907128185ff9473381be53050d202838', 'mac_address': 'fa:16:3e:f3:55:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_interface', 'standard_attr_id': 80, 'fixed_ips': [{'subnet_id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:15:04Z', 'updated_at': '2021-11-24T11:15:11Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'subnets': [{'id': 'c0d420cf-0b8e-4f90-a25c-9a74e1eafabb', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:21:27.821578 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90749227-7308-4d77-a3d3-55be8cf8e3db None None] New status for floating IP a7086214-f429-4a3a-899d-d76c53c3e20f: DOWN {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:21:27.868359 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e2117845-ddad-45f0-b1b3-618309efa20b req-2acdd177-74bd-4d95-a103-2d12d6106ab9 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/ports?device_id=33c1d885-8008-4c47-95d3-dba8aaf38176 HTTP/1.1" status: 200 len: 210 time: 0.0282238 Nov 24 11:21:30.060589 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60590) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:30.115016 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7bfdebb9-506d-460c-9b79-c72db9f0b7c6 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:30.138931 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7bfdebb9-506d-460c-9b79-c72db9f0b7c6 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:30.257232 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7bfdebb9-506d-460c-9b79-c72db9f0b7c6 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:30.261258 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7bfdebb9-506d-460c-9b79-c72db9f0b7c6 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:30.262583 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-7bfdebb9-506d-460c-9b79-c72db9f0b7c6 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "DELETE /v2.0/security-groups/bb1075fc-6aff-413d-aede-b8cd5b582753 HTTP/1.1" status: 204 len: 168 time: 0.2009938 Nov 24 11:21:30.265481 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60592) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:30.271842 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bfdebb9-506d-460c-9b79-c72db9f0b7c6 tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb1075fc-6aff-413d-aede-b8cd5b582753,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:30.279988 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.api.v2.resource [None req-fe53d016-5b0e-4dd3-8db0-125a5938ff1c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] show failed (client error): The resource could not be found. Nov 24 11:21:30.283951 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-fe53d016-5b0e-4dd3-8db0-125a5938ff1c tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "GET /v2.0/security-groups/bb1075fc-6aff-413d-aede-b8cd5b582753 HTTP/1.1" status: 404 len: 347 time: 0.0144298 Nov 24 11:21:30.286171 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60594) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:30.410182 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-5dac5985-4b7b-4f25-95d6-8df4a8106bab tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Deleting port 376f8f31-41d7-4cda-9de3-269d9e4dac82 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:21:30.410576 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5dac5985-4b7b-4f25-95d6-8df4a8106bab tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:30.460575 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device dafd269f-c5b4-41c6-b4f9-8869f4f91f59 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:21:30.480351 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: dafd269f-c5b4-41c6-b4f9-8869f4f91f59 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:21:30.480691 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device dafd269f-c5b4-41c6-b4f9-8869f4f91f59 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:21:30.486472 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5dac5985-4b7b-4f25-95d6-8df4a8106bab tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:30.486788 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5dac5985-4b7b-4f25-95d6-8df4a8106bab tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:30.498705 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-5dac5985-4b7b-4f25-95d6-8df4a8106bab tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Calling delete_port for 376f8f31-41d7-4cda-9de3-269d9e4dac82 owned by network:floatingip {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:21:30.680327 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5dac5985-4b7b-4f25-95d6-8df4a8106bab tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:30.706169 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dac5985-4b7b-4f25-95d6-8df4a8106bab tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Pushing event deleted for resources: {'Port': ['ID=376f8f31-41d7-4cda-9de3-269d9e4dac82,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:30.766544 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5dac5985-4b7b-4f25-95d6-8df4a8106bab tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks [] for floatingip, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:30.769405 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5dac5985-4b7b-4f25-95d6-8df4a8106bab tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:30.770560 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-5dac5985-4b7b-4f25-95d6-8df4a8106bab tempest-AttachVolumeTestJSON-1843471849 tempest-AttachVolumeTestJSON-1843471849-project] 10.222.0.76 "DELETE /v2.0/floatingips/a7086214-f429-4a3a-899d-d76c53c3e20f HTTP/1.1" status: 204 len: 168 time: 0.4833744 Nov 24 11:21:34.700906 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60622) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:35.134412 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2e76db2b-aa00-4e68-9c55-5eda901662cc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1009613'] for router_interface, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:35.370567 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-2e76db2b-aa00-4e68-9c55-5eda901662cc admin admin] Deleting port 19717b1c-5b56-45d5-911e-2c1406e74b2b {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:21:35.370896 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2e76db2b-aa00-4e68-9c55-5eda901662cc admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:35.445595 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-2e76db2b-aa00-4e68-9c55-5eda901662cc admin admin] For port 19717b1c-5b56-45d5-911e-2c1406e74b2b, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=19717b1c-5b56-45d5-911e-2c1406e74b2b,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:21:35.445963 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2e76db2b-aa00-4e68-9c55-5eda901662cc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:35.458792 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-2e76db2b-aa00-4e68-9c55-5eda901662cc admin admin] Calling delete_port for 19717b1c-5b56-45d5-911e-2c1406e74b2b owned by network:router_interface {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:21:35.700372 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2e76db2b-aa00-4e68-9c55-5eda901662cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:35.724188 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e76db2b-aa00-4e68-9c55-5eda901662cc admin admin] Pushing event deleted for resources: {'Port': ['ID=19717b1c-5b56-45d5-911e-2c1406e74b2b,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:35.891325 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2e76db2b-aa00-4e68-9c55-5eda901662cc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-637217', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1011037'] for router_interface, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:36.098455 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2e76db2b-aa00-4e68-9c55-5eda901662cc admin admin] Router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:21:36.201397 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e76db2b-aa00-4e68-9c55-5eda901662cc admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:21:36.206355 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2e76db2b-aa00-4e68-9c55-5eda901662cc admin admin] 10.222.0.76 "PUT /v2.0/routers/4e3f49a3-6e8d-47c7-ae8a-a127354c4431/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5044200 Nov 24 11:21:36.209379 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60626) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:36.210397 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22638f04-08bb-42d9-8104-aa67219249ec None None] Sync routers for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:21:36.221010 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22638f04-08bb-42d9-8104-aa67219249ec None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:21:36.221604 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-22638f04-08bb-42d9-8104-aa67219249ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:21:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:36.327798 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-22638f04-08bb-42d9-8104-aa67219249ec None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:21:36.511711 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-22638f04-08bb-42d9-8104-aa67219249ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:21:35Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:36.559987 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Publish callbacks [] for router, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:36.655591 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22638f04-08bb-42d9-8104-aa67219249ec None None] Checking router: 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:21:36.663841 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22638f04-08bb-42d9-8104-aa67219249ec None None] Routers {'4e3f49a3-6e8d-47c7-ae8a-a127354c4431'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:21:36.664372 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-22638f04-08bb-42d9-8104-aa67219249ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:21:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:36.664492 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:36.767385 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-22638f04-08bb-42d9-8104-aa67219249ec None None] Set router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:21:36.794810 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Deleting port 58dbaf25-a351-409e-9cca-b5ab345c35a1 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:21:36.794810 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:36.872205 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] For port 58dbaf25-a351-409e-9cca-b5ab345c35a1, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=58dbaf25-a351-409e-9cca-b5ab345c35a1,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:21:36.872566 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:36.884921 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Calling delete_port for 58dbaf25-a351-409e-9cca-b5ab345c35a1 owned by network:router_gateway {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:21:36.945658 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-22638f04-08bb-42d9-8104-aa67219249ec None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:21:35Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:36.975230 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-22638f04-08bb-42d9-8104-aa67219249ec None None] The sync data for ids ['4e3f49a3-6e8d-47c7-ae8a-a127354c4431'] in dv-cinder-804035-18-iscsi is: [{'id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'name': 'tempest-AttachVolumeTestJSON-1888201214-router', 'tenant_id': '907128185ff9473381be53050d202838', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212'}], 'enable_snat': True}, 'gw_port_id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:57Z', 'updated_at': '2021-11-24T11:21:35Z', 'revision_number': 5, 'project_id': '907128185ff9473381be53050d202838', 'gw_port': {'id': '58dbaf25-a351-409e-9cca-b5ab345c35a1', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:dc:ed:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4e3f49a3-6e8d-47c7-ae8a-a127354c4431', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.212', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:58Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:21:37.116686 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.146738 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Pushing event deleted for resources: {'Port': ['ID=58dbaf25-a351-409e-9cca-b5ab345c35a1,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:37.206979 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-942710'] for router_gateway, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.296264 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1010955', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-663'] for router, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.298439 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.420025 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1010962'] for router, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.420792 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4e3f49a3-6e8d-47c7-ae8a-a127354c4431 {{(pid=103244) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 11:21:37.425873 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] Publish callbacks [] for router, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.427093 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-875eb467-fc11-4fa5-9a45-86dac53ae028 admin admin] 10.222.0.76 "DELETE /v2.0/routers/4e3f49a3-6e8d-47c7-ae8a-a127354c4431 HTTP/1.1" status: 204 len: 168 time: 1.2167881 Nov 24 11:21:37.429752 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60628) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:37.443565 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 19717b1c-5b56-45d5-911e-2c1406e74b2b no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:21:37.467001 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 19717b1c-5b56-45d5-911e-2c1406e74b2b {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:21:37.467665 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 19717b1c-5b56-45d5-911e-2c1406e74b2b not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:21:37.484048 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_v2 [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Deleting subnet c0d420cf-0b8e-4f90-a25c-9a74e1eafabb {{(pid=103244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:21:37.487238 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.521098 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4161249'] for subnet, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.599473 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.728841 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8699037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8480512'] for subnet, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.757894 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c0d420cf-0b8e-4f90-a25c-9a74e1eafabb,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:37.762935 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.766111 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/c0d420cf-0b8e-4f90-a25c-9a74e1eafabb HTTP/1.1" status: 204 len: 168 time: 0.3352401 Nov 24 11:21:37.768566 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b22b04db-fbe2-48b1-b589-d494b1fcb004 None None] Network d9d87ca8-7863-48a6-937c-ee712996776e requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:21:37.769058 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60630) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:37.771829 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:37.772180 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:37.772545 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:37.772879 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:37.773208 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:37.773538 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:37.773865 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:37.774191 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:37.774519 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:37.775277 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:37.775277 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:37.775508 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e6c3500e-275f-4de6-b7d9-81036f87bda6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:37.842263 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.896218 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Deleting port a31debe2-2770-4881-bff9-df26c1e9bb50 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:21:37.896437 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.963333 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] For port a31debe2-2770-4881-bff9-df26c1e9bb50, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a31debe2-2770-4881-bff9-df26c1e9bb50,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:21:37.963333 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:37.976254 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Calling delete_port for a31debe2-2770-4881-bff9-df26c1e9bb50 owned by network:dhcp {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:21:37.998382 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] DHCP port deletion for d9d87ca8-7863-48a6-937c-ee712996776e request from dv-cinder-804035-18-iscsi {{(pid=103245) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 11:21:38.053147 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Deleting port a31debe2-2770-4881-bff9-df26c1e9bb50 {{(pid=103245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:21:38.053574 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.118626 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] For port a31debe2-2770-4881-bff9-df26c1e9bb50, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a31debe2-2770-4881-bff9-df26c1e9bb50,segment=NetworkSegment(79007d98-8337-4c9d-b362-284f4dc6590e),segment_id=79007d98-8337-4c9d-b362-284f4dc6590e)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:21:38.119020 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.122596 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.140093 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Calling delete_port for a31debe2-2770-4881-bff9-df26c1e9bb50 owned by network:dhcp {{(pid=103245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:21:38.149235 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Pushing event deleted for resources: {'Port': ['ID=a31debe2-2770-4881-bff9-df26c1e9bb50,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:38.151251 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] No DVR routers for this DVR port a31debe2-2770-4881-bff9-df26c1e9bb50 on host dv-cinder-804035-18-iscsi {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:21:38.208795 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.223351 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.234626 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Pushing event deleted for resources: {'Port': ['ID=a31debe2-2770-4881-bff9-df26c1e9bb50,revision_number=None']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:38.239639 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] No DVR routers for this DVR port a31debe2-2770-4881-bff9-df26c1e9bb50 on host dv-cinder-804035-18-iscsi {{(pid=103245) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:21:38.242908 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d9d87ca8-7863-48a6-937c-ee712996776e']}} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:38.250287 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:38.250287 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:38.250287 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:38.250287 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:38.250287 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:38.250943 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:38.250943 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:38.251248 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:38.251551 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:38.252024 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:38.252156 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:38.252501 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea56461c-e7eb-402a-babc-adad6d50fc84 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:21:38.255429 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '79007d98-8337-4c9d-b362-284f4dc6590e') {'for_net_delete': True} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:38.255429 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '79007d98-8337-4c9d-b362-284f4dc6590e') {} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:38.265463 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-9292944'] for segment, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.278285 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.284132 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Releasing vlan 1216 on physical network physnet1 to pool {{(pid=103243) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:21:38.284516 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8721920'] for segment, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: Traceback (most recent call last): Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: timer() Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: cb(*args, **kw) Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: return func(*args, **kwargs) Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: self._notify() Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: self.callback(batched_events) Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: event.method(event) Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: return f(self, *a, **k) Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._get(url).json() Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: return self.request(url, 'GET', **kwargs) Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:21:38.286183 dv-cinder-804035-18-iscsi neutron-server[103243]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:21:38.400214 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.407565 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.410683 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] 10.222.0.76 "DELETE /v2.0/networks/d9d87ca8-7863-48a6-937c-ee712996776e HTTP/1.1" status: 204 len: 168 time: 0.6404343 Nov 24 11:21:38.421031 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec120890-1a87-410a-9cca-040059f4947a admin admin] Pushing event deleted for resources: {'Network': ['ID=d9d87ca8-7863-48a6-937c-ee712996776e,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:38.730484 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60634) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:38.770350 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-2a57a665-e2b7-4fa1-bc4c-c3c777021a62 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=907128185ff9473381be53050d202838&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0387003 Nov 24 11:21:38.772902 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60636) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:38.800301 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4729baa1-e623-4342-82ba-d5ad056b3f7d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.821116 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-04ff7a61-1814-4b8d-944f-b9f837eebf1e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.842549 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-04ff7a61-1814-4b8d-944f-b9f837eebf1e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.983110 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-04ff7a61-1814-4b8d-944f-b9f837eebf1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.985701 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-04ff7a61-1814-4b8d-944f-b9f837eebf1e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:38.986843 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-04ff7a61-1814-4b8d-944f-b9f837eebf1e admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/5df4ff95-0bc3-4454-a779-cc479e6904a1 HTTP/1.1" status: 204 len: 168 time: 0.2130389 Nov 24 11:21:38.994568 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04ff7a61-1814-4b8d-944f-b9f837eebf1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5df4ff95-0bc3-4454-a779-cc479e6904a1,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:39.128843 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 58dbaf25-a351-409e-9cca-b5ab345c35a1 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:21:39.153292 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 58dbaf25-a351-409e-9cca-b5ab345c35a1 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:21:39.153630 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 58dbaf25-a351-409e-9cca-b5ab345c35a1 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:21:39.154025 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a31debe2-2770-4881-bff9-df26c1e9bb50 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:21:39.174964 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: a31debe2-2770-4881-bff9-df26c1e9bb50 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:21:39.175324 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a31debe2-2770-4881-bff9-df26c1e9bb50 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:21:39.254228 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:41.139519 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-1ac79e3d-fd77-45a5-9ec0-c118a254e16f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:42.453599 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:44.053735 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:44.794490 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:45.074194 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:21:50.168215 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60754) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:50.269894 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d50185f8-243e-4234-ae92-9e888b4fce98 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:50.341801 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d50185f8-243e-4234-ae92-9e888b4fce98 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:50.408008 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-d50185f8-243e-4234-ae92-9e888b4fce98 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:50.446945 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d50185f8-243e-4234-ae92-9e888b4fce98 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2851313-6bbf-4f46-ac1e-28075d93c526,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:50.451802 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-d50185f8-243e-4234-ae92-9e888b4fce98 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=ae49bbb264af4382965cf980b76e0ed7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2825997 Nov 24 11:21:50.454362 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60758) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:50.500580 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5e5c0bff-bae5-4e3a-bafe-097497e2b7f3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:50.521360 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5e5c0bff-bae5-4e3a-bafe-097497e2b7f3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:50.630876 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5e5c0bff-bae5-4e3a-bafe-097497e2b7f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:50.633572 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5e5c0bff-bae5-4e3a-bafe-097497e2b7f3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:50.634725 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-5e5c0bff-bae5-4e3a-bafe-097497e2b7f3 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/a2851313-6bbf-4f46-ac1e-28075d93c526 HTTP/1.1" status: 204 len: 168 time: 0.1794763 Nov 24 11:21:50.643696 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e5c0bff-bae5-4e3a-bafe-097497e2b7f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2851313-6bbf-4f46-ac1e-28075d93c526,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:51.624668 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60780) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:51.717710 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2072326285-network', 'tenant_id': 'd87050b3e3d44eff97d6107920395a2f'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:21:51.869009 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Made reservation on behalf of d87050b3e3d44eff97d6107920395a2f for: {'network': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:21:51.871651 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:51.880252 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:51.952484 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:52.007752 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:52.035423 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1218} {{(pid=103243) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:21:52.044891 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=99a6de8c-2734-40d5-8ed6-63216e6525d8,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:52.049431 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:52.049772 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.segments_db [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Added segment 01ad177a-210a-46c1-9d9f-30c6c8df360c of type vlan for network 2abce187-b1b9-4cd8-ae24-65e1e3b67222 Nov 24 11:21:52.088822 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:52.177525 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:52.178427 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:52.179025 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:52.238356 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] Pushing event updated for resources: {'Network': ['ID=2abce187-b1b9-4cd8-ae24-65e1e3b67222,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:52.248969 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 2abce187-b1b9-4cd8-ae24-65e1e3b67222 details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:21:52.291071 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-3c54b4e7-58c0-4298-ab32-905748351560 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 899 time: 0.6653085 Nov 24 11:21:52.293935 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60784) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:52.298678 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-123e646b-dffa-4aea-a566-8e034f4f5a56 admin admin] Request body: {'subnet': {'network_id': '2abce187-b1b9-4cd8-ae24-65e1e3b67222', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2072326285-subnet', 'tenant_id': 'd87050b3e3d44eff97d6107920395a2f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:21:52.400033 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-123e646b-dffa-4aea-a566-8e034f4f5a56 admin admin] Made reservation on behalf of d87050b3e3d44eff97d6107920395a2f for: {'subnet': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:21:52.402655 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-123e646b-dffa-4aea-a566-8e034f4f5a56 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9106670'] for subnet, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:52.619381 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-123e646b-dffa-4aea-a566-8e034f4f5a56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8721775', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9106652'] for subnet, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:52.682605 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-123e646b-dffa-4aea-a566-8e034f4f5a56 admin admin] Pushing event updated for resources: {'Subnet': ['ID=56b55650-cdf5-416e-a2ae-ac8a4e8ed86e,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:52.686742 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-123e646b-dffa-4aea-a566-8e034f4f5a56 admin admin] Checking segment: {'id': '01ad177a-210a-46c1-9d9f-30c6c8df360c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1218, 'network_id': '2abce187-b1b9-4cd8-ae24-65e1e3b67222'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:21:52.687101 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-123e646b-dffa-4aea-a566-8e034f4f5a56 admin admin] Network hostable DHCP agents. Network: 2abce187-b1b9-4cd8-ae24-65e1e3b67222, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103243) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:21:52.768000 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-123e646b-dffa-4aea-a566-8e034f4f5a56 admin admin] Network 2abce187-b1b9-4cd8-ae24-65e1e3b67222 is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103243) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:21:52.848221 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-123e646b-dffa-4aea-a566-8e034f4f5a56 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 2abce187-b1b9-4cd8-ae24-65e1e3b67222) {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:21:52.852270 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-123e646b-dffa-4aea-a566-8e034f4f5a56 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:52.852856 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-123e646b-dffa-4aea-a566-8e034f4f5a56 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:52.857577 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c1dda7e-26b8-4a23-8c14-45818266a026 None None] Network 2abce187-b1b9-4cd8-ae24-65e1e3b67222 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:21:52.953649 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-123e646b-dffa-4aea-a566-8e034f4f5a56 admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.6584411 Nov 24 11:21:52.979757 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fcc9642c-110b-40fc-95c9-f828382cab93 None None] Network 2abce187-b1b9-4cd8-ae24-65e1e3b67222 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:21:53.591811 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60802) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:53.596630 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1726243602-network', 'tenant_id': '714ad8a9d8a34b058f8ff6f4aa951f1b'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:21:53.676387 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Made reservation on behalf of 714ad8a9d8a34b058f8ff6f4aa951f1b for: {'network': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:21:53.678677 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:53.688486 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:53.760283 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:53.922505 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:53.946733 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1216} {{(pid=103244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:21:53.955476 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cfbb5b5a-bc08-4f11-aa21-7aa5eb3aa9f1,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:53.962328 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:53.962666 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.segments_db [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Added segment a3171087-6bad-4a02-bce8-6263407c310b of type vlan for network 857d6d84-3230-4c16-8ba4-ee8f2a864a2d Nov 24 11:21:54.002125 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:54.093945 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:54.094931 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:54.095549 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:54.157832 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] Pushing event updated for resources: {'Network': ['ID=857d6d84-3230-4c16-8ba4-ee8f2a864a2d,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:54.167167 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 857d6d84-3230-4c16-8ba4-ee8f2a864a2d details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:21:54.208623 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-c678a85a-fc1e-4b0d-b294-cf5b7de81edb admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 899 time: 0.6157207 Nov 24 11:21:54.211598 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60804) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:54.217710 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-67b90b2b-5758-4fac-abff-5b8b02315e2a admin admin] Request body: {'subnet': {'network_id': '857d6d84-3230-4c16-8ba4-ee8f2a864a2d', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1726243602-subnet', 'tenant_id': '714ad8a9d8a34b058f8ff6f4aa951f1b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:21:54.294340 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-67b90b2b-5758-4fac-abff-5b8b02315e2a admin admin] Made reservation on behalf of 714ad8a9d8a34b058f8ff6f4aa951f1b for: {'subnet': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:21:54.296801 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-67b90b2b-5758-4fac-abff-5b8b02315e2a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8480549'] for subnet, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:54.537693 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-67b90b2b-5758-4fac-abff-5b8b02315e2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8698972', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8480535'] for subnet, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:54.593708 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67b90b2b-5758-4fac-abff-5b8b02315e2a admin admin] Pushing event updated for resources: {'Subnet': ['ID=a2b6d2e9-0da8-4cc3-b346-def1f8bf77ba,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:54.601512 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67b90b2b-5758-4fac-abff-5b8b02315e2a admin admin] Checking segment: {'id': 'a3171087-6bad-4a02-bce8-6263407c310b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1216, 'network_id': '857d6d84-3230-4c16-8ba4-ee8f2a864a2d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:21:54.601864 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67b90b2b-5758-4fac-abff-5b8b02315e2a admin admin] Network hostable DHCP agents. Network: 857d6d84-3230-4c16-8ba4-ee8f2a864a2d, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:21:54.685866 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67b90b2b-5758-4fac-abff-5b8b02315e2a admin admin] Network 857d6d84-3230-4c16-8ba4-ee8f2a864a2d is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:21:54.765931 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-67b90b2b-5758-4fac-abff-5b8b02315e2a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 857d6d84-3230-4c16-8ba4-ee8f2a864a2d) {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:21:54.770608 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67b90b2b-5758-4fac-abff-5b8b02315e2a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:54.771824 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-67b90b2b-5758-4fac-abff-5b8b02315e2a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:54.775265 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ab1f083-9e8d-4e64-8f52-b066369a2837 None None] Network 857d6d84-3230-4c16-8ba4-ee8f2a864a2d requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:21:54.879355 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-67b90b2b-5758-4fac-abff-5b8b02315e2a admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.6650069 Nov 24 11:21:54.902505 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e2f0bc3-f14f-4f9b-92e2-4aa55d92f21e None None] Network 857d6d84-3230-4c16-8ba4-ee8f2a864a2d requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:21:55.001646 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60816) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:55.045986 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_v2 [None req-04a28ebe-f940-4eba-81e2-9775ce8e2025 admin admin] Deleting subnet 56b55650-cdf5-416e-a2ae-ac8a4e8ed86e {{(pid=103244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:21:55.049422 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-04a28ebe-f940-4eba-81e2-9775ce8e2025 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.089138 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-04a28ebe-f940-4eba-81e2-9775ce8e2025 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4161249'] for subnet, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.127742 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-04a28ebe-f940-4eba-81e2-9775ce8e2025 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.264241 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-04a28ebe-f940-4eba-81e2-9775ce8e2025 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8699037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8480512'] for subnet, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.290245 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04a28ebe-f940-4eba-81e2-9775ce8e2025 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=56b55650-cdf5-416e-a2ae-ac8a4e8ed86e,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:55.296294 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-04a28ebe-f940-4eba-81e2-9775ce8e2025 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.298456 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-04a28ebe-f940-4eba-81e2-9775ce8e2025 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/56b55650-cdf5-416e-a2ae-ac8a4e8ed86e HTTP/1.1" status: 204 len: 168 time: 0.2958124 Nov 24 11:21:55.300977 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60818) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:55.374550 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.482293 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.510987 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578c0840-22e2-4e9a-b63e-9ed0ae4e2560 req-a42c44eb-c10d-487a-bedb-2a89eba0d30b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:55.512593 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-578c0840-22e2-4e9a-b63e-9ed0ae4e2560 req-a42c44eb-c10d-487a-bedb-2a89eba0d30b tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 946 time: 0.1092331 Nov 24 11:21:55.514037 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2abce187-b1b9-4cd8-ae24-65e1e3b67222']}} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:55.530459 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '01ad177a-210a-46c1-9d9f-30c6c8df360c') {'for_net_delete': True} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:55.530743 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '01ad177a-210a-46c1-9d9f-30c6c8df360c') {} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:55.546959 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4161272'] for segment, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.572170 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.584076 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-578c0840-22e2-4e9a-b63e-9ed0ae4e2560 req-9ebb5b2e-1a36-4939-acd9-1d774f2a0c3a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0629365 Nov 24 11:21:55.585023 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] Releasing vlan 1218 on physical network physnet1 to pool {{(pid=103244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:21:55.585402 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8699699'] for segment, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: Traceback (most recent call last): Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: timer() Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: cb(*args, **kw) Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: return func(*args, **kwargs) Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: self._notify() Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: self.callback(batched_events) Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: event.method(event) Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: return f(self, *a, **k) Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._get(url).json() Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: return self.request(url, 'GET', **kwargs) Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:21:55.587145 dv-cinder-804035-18-iscsi neutron-server[103244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:21:55.754763 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.759107 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.763162 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] 10.222.0.76 "DELETE /v2.0/networks/2abce187-b1b9-4cd8-ae24-65e1e3b67222 HTTP/1.1" status: 204 len: 168 time: 0.4612246 Nov 24 11:21:55.765998 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60822) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:55.775412 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85ad5781-f396-4c9b-9a42-1b78ca31b66b admin admin] Pushing event deleted for resources: {'Network': ['ID=2abce187-b1b9-4cd8-ae24-65e1e3b67222,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:55.810700 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_v2 [None req-f7d9b8ff-a507-4e52-ab1f-8e1befd36b83 admin admin] Deleting subnet a2b6d2e9-0da8-4cc3-b346-def1f8bf77ba {{(pid=103243) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:21:55.813978 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f7d9b8ff-a507-4e52-ab1f-8e1befd36b83 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.848190 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f7d9b8ff-a507-4e52-ab1f-8e1befd36b83 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-9292937'] for subnet, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:55.884565 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f7d9b8ff-a507-4e52-ab1f-8e1befd36b83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:56.002353 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f7d9b8ff-a507-4e52-ab1f-8e1befd36b83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8721838', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9106635'] for subnet, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:56.029306 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7d9b8ff-a507-4e52-ab1f-8e1befd36b83 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a2b6d2e9-0da8-4cc3-b346-def1f8bf77ba,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:56.031216 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f7d9b8ff-a507-4e52-ab1f-8e1befd36b83 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:56.034393 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-f7d9b8ff-a507-4e52-ab1f-8e1befd36b83 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/a2b6d2e9-0da8-4cc3-b346-def1f8bf77ba HTTP/1.1" status: 204 len: 168 time: 0.2673235 Nov 24 11:21:56.037027 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60824) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:56.105556 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:56.182370 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:56.201369 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['857d6d84-3230-4c16-8ba4-ee8f2a864a2d']}} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:56.210340 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a3171087-6bad-4a02-bce8-6263407c310b') {'for_net_delete': True} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:56.210632 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a3171087-6bad-4a02-bce8-6263407c310b') {} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:56.220037 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-9292944'] for segment, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:56.233183 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:56.238923 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] Releasing vlan 1216 on physical network physnet1 to pool {{(pid=103243) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:21:56.239326 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8721920'] for segment, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: Traceback (most recent call last): Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: timer() Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: cb(*args, **kw) Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: return func(*args, **kwargs) Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: self._notify() Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: self.callback(batched_events) Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: event.method(event) Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: return f(self, *a, **k) Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._get(url).json() Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: return self.request(url, 'GET', **kwargs) Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:21:56.240911 dv-cinder-804035-18-iscsi neutron-server[103243]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:21:56.614022 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:56.619531 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:56.625414 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] 10.222.0.76 "DELETE /v2.0/networks/857d6d84-3230-4c16-8ba4-ee8f2a864a2d HTTP/1.1" status: 204 len: 168 time: 0.5852473 Nov 24 11:21:56.634069 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-833432ec-6a44-441d-b2c7-684035577f66 admin admin] Pushing event deleted for resources: {'Network': ['ID=857d6d84-3230-4c16-8ba4-ee8f2a864a2d,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:56.718907 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-312a4589-847e-41ee-906d-6bf9ef89257b req-088b26ad-fad9-4cb9-bebf-587c79d18c4a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:56.720456 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-312a4589-847e-41ee-906d-6bf9ef89257b req-088b26ad-fad9-4cb9-bebf-587c79d18c4a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 946 time: 0.0546265 Nov 24 11:21:56.767685 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-312a4589-847e-41ee-906d-6bf9ef89257b req-aae8d6f4-2f5e-40ec-ace8-7d31bf87c44a tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups?id=064a1953-b8d0-4c91-993b-f0605de9a95a&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0411842 Nov 24 11:21:56.793359 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-9d929845-26e5-4112-b84d-ba810c6c139f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:21:56.793918 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-9d929845-26e5-4112-b84d-ba810c6c139f tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.86 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 946 time: 0.0539174 Nov 24 11:21:56.891818 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Deleting port 99ed14d7-8b44-45c2-98b0-6d15ba385922 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:21:56.892158 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:56.980699 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60830) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:56.986081 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] For port 99ed14d7-8b44-45c2-98b0-6d15ba385922, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99ed14d7-8b44-45c2-98b0-6d15ba385922,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:21:56.986445 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:57.021899 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-d3b311f2-cc49-4776-aff0-c900cf4412d2 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=d87050b3e3d44eff97d6107920395a2f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0374742 Nov 24 11:21:57.022124 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60832) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:57.070977 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7f73915e-ee19-4f02-ba6a-742ecdadcca9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:57.095908 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7f73915e-ee19-4f02-ba6a-742ecdadcca9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:57.162856 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:57.163176 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:57.163517 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.l3_db [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Floating IP 77db85ba-8d04-452a-929c-9c9b8c4880a6 disassociated. External IP: 172.27.3.74, port: 99ed14d7-8b44-45c2-98b0-6d15ba385922. Nov 24 11:21:57.163849 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Calling delete_port for 99ed14d7-8b44-45c2-98b0-6d15ba385922 owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:21:57.228717 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7f73915e-ee19-4f02-ba6a-742ecdadcca9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:57.231821 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7f73915e-ee19-4f02-ba6a-742ecdadcca9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:57.233210 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-7f73915e-ee19-4f02-ba6a-742ecdadcca9 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/99a6de8c-2734-40d5-8ed6-63216e6525d8 HTTP/1.1" status: 204 len: 168 time: 0.2102497 Nov 24 11:21:57.253170 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f73915e-ee19-4f02-ba6a-742ecdadcca9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=99a6de8c-2734-40d5-8ed6-63216e6525d8,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:57.354683 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:57.383840 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event deleted for resources: {'Port': ['ID=99ed14d7-8b44-45c2-98b0-6d15ba385922,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:57.501176 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Router 7bb4df85-5735-4ea8-9136-d2387a677310 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:21:57.609228 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:21:57.619854 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-989ec937-b564-443d-bd9e-79a09ea5a842 None None] Sync routers for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:21:57.630804 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-989ec937-b564-443d-bd9e-79a09ea5a842 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:21:57.631564 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-989ec937-b564-443d-bd9e-79a09ea5a842 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:21:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:57.648605 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] No DVR routers for this DVR port 99ed14d7-8b44-45c2-98b0-6d15ba385922 on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:21:57.651040 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:57.654589 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e4cbe870-9d30-4f60-a936-b21745bdc245 req-ee29627f-67dd-4b0b-b9be-e7bf171a3d2d tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.86 "DELETE /v2.0/ports/99ed14d7-8b44-45c2-98b0-6d15ba385922 HTTP/1.1" status: 204 len: 173 time: 0.8545957 Nov 24 11:21:57.654967 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'name': 'network-vif-deleted', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:21:57.657244 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-643f1aeb-7cec-47d0-93f7-9bb1f6ee8a07" -d '{"events": [{"server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "name": "network-vif-deleted", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:21:57.694166 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:21:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-976848a9-3495-4fff-a1d8-ee6ad991170d x-openstack-request-id: req-976848a9-3495-4fff-a1d8-ee6ad991170d {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:21:57.694569 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ca290e6c-e383-4cec-b623-6ce7be1d9a8e", "name": "network-vif-deleted", "tag": "99ed14d7-8b44-45c2-98b0-6d15ba385922", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:21:57.694926 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-976848a9-3495-4fff-a1d8-ee6ad991170d {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:21:57.695366 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ca290e6c-e383-4cec-b623-6ce7be1d9a8e', 'name': 'network-vif-deleted', 'tag': '99ed14d7-8b44-45c2-98b0-6d15ba385922', 'status': 'completed', 'code': 200} Nov 24 11:21:57.755164 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-989ec937-b564-443d-bd9e-79a09ea5a842 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:21:57.892404 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-93ff8319-9652-41b9-96a7-0b2f0585e634 req-d6233214-6643-4cd0-b43c-ba835d139bdb tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/ports?device_id=ca290e6c-e383-4cec-b623-6ce7be1d9a8e HTTP/1.1" status: 200 len: 210 time: 0.0359821 Nov 24 11:21:57.931183 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60842) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:57.971648 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-989ec937-b564-443d-bd9e-79a09ea5a842 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:57.974523 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-337f6f88-1d42-42d4-be7b-53f2878757e1 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=714ad8a9d8a34b058f8ff6f4aa951f1b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0419466 Nov 24 11:21:57.977107 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60844) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:57.999684 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-989ec937-b564-443d-bd9e-79a09ea5a842 None None] Checking router: 7bb4df85-5735-4ea8-9136-d2387a677310 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:21:58.009263 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-989ec937-b564-443d-bd9e-79a09ea5a842 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:21:58.009861 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-989ec937-b564-443d-bd9e-79a09ea5a842 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:21:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:58.029471 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ff9765c4-c43a-48d8-886f-b1d2bea46500 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:58.051324 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ff9765c4-c43a-48d8-886f-b1d2bea46500 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:58.116016 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-989ec937-b564-443d-bd9e-79a09ea5a842 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:21:58.177911 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ff9765c4-c43a-48d8-886f-b1d2bea46500 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:58.180595 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ff9765c4-c43a-48d8-886f-b1d2bea46500 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:58.181926 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-ff9765c4-c43a-48d8-886f-b1d2bea46500 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/cfbb5b5a-bc08-4f11-aa21-7aa5eb3aa9f1 HTTP/1.1" status: 204 len: 168 time: 0.2035360 Nov 24 11:21:58.190827 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff9765c4-c43a-48d8-886f-b1d2bea46500 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cfbb5b5a-bc08-4f11-aa21-7aa5eb3aa9f1,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:58.324236 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-989ec937-b564-443d-bd9e-79a09ea5a842 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:21:58.350714 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-989ec937-b564-443d-bd9e-79a09ea5a842 None None] The sync data for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi is: [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:00Z', 'revision_number': 4, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '1b6f5e32-07ed-47f9-a43d-ab92febf678e', 'name': '', 'network_id': '76fcee22-81e5-4608-a546-3b68c56c5ac7', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'mac_address': 'fa:16:3e:8d:ef:a6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_interface', 'standard_attr_id': 68, 'fixed_ips': [{'subnet_id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:59Z', 'updated_at': '2021-11-24T11:15:07Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'subnets': [{'id': '5eae2e87-935a-45b7-89da-586ce04ad644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:21:58.563763 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d4f310f7-c171-48ea-afb4-7c4f4c5e4b29 None None] New status for floating IP 77db85ba-8d04-452a-929c-9c9b8c4880a6: DOWN {{(pid=103245) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:21:59.044661 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60868) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:59.101989 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2791df9a-6b45-4505-b4f0-ce96bf3b3ec7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:59.125493 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2791df9a-6b45-4505-b4f0-ce96bf3b3ec7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:59.275118 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2791df9a-6b45-4505-b4f0-ce96bf3b3ec7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:59.275118 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2791df9a-6b45-4505-b4f0-ce96bf3b3ec7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:59.275118 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-2791df9a-6b45-4505-b4f0-ce96bf3b3ec7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "DELETE /v2.0/security-groups/064a1953-b8d0-4c91-993b-f0605de9a95a HTTP/1.1" status: 204 len: 168 time: 0.2291856 Nov 24 11:21:59.277663 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60874) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:59.288411 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2791df9a-6b45-4505-b4f0-ce96bf3b3ec7 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=064a1953-b8d0-4c91-993b-f0605de9a95a,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:59.291276 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.api.v2.resource [None req-2034690d-6fb3-41de-8fc9-cc3f10ee3119 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] show failed (client error): The resource could not be found. Nov 24 11:21:59.292686 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2034690d-6fb3-41de-8fc9-cc3f10ee3119 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "GET /v2.0/security-groups/064a1953-b8d0-4c91-993b-f0605de9a95a HTTP/1.1" status: 404 len: 347 time: 0.0139065 Nov 24 11:21:59.295939 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60876) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:21:59.422369 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-4c20821f-29ae-4bce-aa91-57a11f3014f9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Deleting port 77168c31-b9a3-41ea-bd2c-184bd32680f4 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:21:59.422713 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4c20821f-29ae-4bce-aa91-57a11f3014f9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:59.501444 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4c20821f-29ae-4bce-aa91-57a11f3014f9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:59.505739 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4c20821f-29ae-4bce-aa91-57a11f3014f9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:59.513693 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-4c20821f-29ae-4bce-aa91-57a11f3014f9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Calling delete_port for 77168c31-b9a3-41ea-bd2c-184bd32680f4 owned by network:floatingip {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:21:59.705293 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4c20821f-29ae-4bce-aa91-57a11f3014f9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:59.734702 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c20821f-29ae-4bce-aa91-57a11f3014f9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Pushing event deleted for resources: {'Port': ['ID=77168c31-b9a3-41ea-bd2c-184bd32680f4,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:21:59.796006 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4c20821f-29ae-4bce-aa91-57a11f3014f9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks [] for floatingip, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:59.798631 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4c20821f-29ae-4bce-aa91-57a11f3014f9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:21:59.799809 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-4c20821f-29ae-4bce-aa91-57a11f3014f9 tempest-AttachVolumeShelveTestJSON-1493531462 tempest-AttachVolumeShelveTestJSON-1493531462-project] 10.222.0.76 "DELETE /v2.0/floatingips/77db85ba-8d04-452a-929c-9c9b8c4880a6 HTTP/1.1" status: 204 len: 168 time: 0.5029118 Nov 24 11:22:00.616210 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99ed14d7-8b44-45c2-98b0-6d15ba385922 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:22:00.636662 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 99ed14d7-8b44-45c2-98b0-6d15ba385922 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:22:00.637031 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99ed14d7-8b44-45c2-98b0-6d15ba385922 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:22:01.023054 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60912) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:01.136608 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f1489bb7-d8f7-4956-93a1-34bd9be7c4e4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:01.216026 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f1489bb7-d8f7-4956-93a1-34bd9be7c4e4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:01.288423 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f1489bb7-d8f7-4956-93a1-34bd9be7c4e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:01.328541 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-f1489bb7-d8f7-4956-93a1-34bd9be7c4e4 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=dd4033d4c2434c38adffb92fd73d2c85&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3043649 Nov 24 11:22:01.330544 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1489bb7-d8f7-4956-93a1-34bd9be7c4e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2349eafe-8160-45f0-9700-ad515e0afb2a,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:01.331232 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60926) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:01.383191 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f70c427d-dca5-4efe-aad8-8800a24d6cb7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:01.405373 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f70c427d-dca5-4efe-aad8-8800a24d6cb7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:01.533330 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f70c427d-dca5-4efe-aad8-8800a24d6cb7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:01.535932 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f70c427d-dca5-4efe-aad8-8800a24d6cb7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:01.537071 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-f70c427d-dca5-4efe-aad8-8800a24d6cb7 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/2349eafe-8160-45f0-9700-ad515e0afb2a HTTP/1.1" status: 204 len: 168 time: 0.2047932 Nov 24 11:22:01.546214 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f70c427d-dca5-4efe-aad8-8800a24d6cb7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2349eafe-8160-45f0-9700-ad515e0afb2a,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:02.097574 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60932) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:02.114474 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-52b1808f-a9a0-430e-9971-ebd2dd5343e5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:02.186110 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-52b1808f-a9a0-430e-9971-ebd2dd5343e5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:02.248093 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-52b1808f-a9a0-430e-9971-ebd2dd5343e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:02.285376 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-52b1808f-a9a0-430e-9971-ebd2dd5343e5 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=41c404d10da14f71b0e724a09ff97057&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1867435 Nov 24 11:22:02.287382 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52b1808f-a9a0-430e-9971-ebd2dd5343e5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22be0818-cd4f-48dc-bf28-1f849faf45e9,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:02.288245 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60934) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:02.338436 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d7cf7d4a-67f6-4307-8348-802fb7bb7957 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:02.359406 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d7cf7d4a-67f6-4307-8348-802fb7bb7957 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:02.459373 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 60942) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:02.474772 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d7cf7d4a-67f6-4307-8348-802fb7bb7957 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:02.477368 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d7cf7d4a-67f6-4307-8348-802fb7bb7957 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:02.478484 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-d7cf7d4a-67f6-4307-8348-802fb7bb7957 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/22be0818-cd4f-48dc-bf28-1f849faf45e9 HTTP/1.1" status: 204 len: 168 time: 0.1892638 Nov 24 11:22:02.487467 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7cf7d4a-67f6-4307-8348-802fb7bb7957 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22be0818-cd4f-48dc-bf28-1f849faf45e9,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:02.950275 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5d98deb7-5e96-4c73-b504-2bc6046ac4ad admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1009613'] for router_interface, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:03.204378 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-5d98deb7-5e96-4c73-b504-2bc6046ac4ad admin admin] Deleting port 1b6f5e32-07ed-47f9-a43d-ab92febf678e {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:22:03.204618 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5d98deb7-5e96-4c73-b504-2bc6046ac4ad admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:03.283384 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-5d98deb7-5e96-4c73-b504-2bc6046ac4ad admin admin] For port 1b6f5e32-07ed-47f9-a43d-ab92febf678e, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=1b6f5e32-07ed-47f9-a43d-ab92febf678e,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:22:03.283771 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5d98deb7-5e96-4c73-b504-2bc6046ac4ad admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:03.298011 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-5d98deb7-5e96-4c73-b504-2bc6046ac4ad admin admin] Calling delete_port for 1b6f5e32-07ed-47f9-a43d-ab92febf678e owned by network:router_interface {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:22:03.533900 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5d98deb7-5e96-4c73-b504-2bc6046ac4ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:03.564767 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d98deb7-5e96-4c73-b504-2bc6046ac4ad admin admin] Pushing event deleted for resources: {'Port': ['ID=1b6f5e32-07ed-47f9-a43d-ab92febf678e,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:03.734851 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5d98deb7-5e96-4c73-b504-2bc6046ac4ad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-637217', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1011037'] for router_interface, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:04.200853 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5d98deb7-5e96-4c73-b504-2bc6046ac4ad admin admin] Router 7bb4df85-5735-4ea8-9136-d2387a677310 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:22:04.311553 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5d98deb7-5e96-4c73-b504-2bc6046ac4ad admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:22:04.317019 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-5d98deb7-5e96-4c73-b504-2bc6046ac4ad admin admin] 10.222.0.76 "PUT /v2.0/routers/7bb4df85-5735-4ea8-9136-d2387a677310/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8566220 Nov 24 11:22:04.320225 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60984) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:04.321890 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6843bbd2-6636-4d45-b8dd-6ff427fbf371 None None] Sync routers for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:22:04.340621 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6843bbd2-6636-4d45-b8dd-6ff427fbf371 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:22:04.340621 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-6843bbd2-6636-4d45-b8dd-6ff427fbf371 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:21:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:22:04.431511 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Publish callbacks [] for router, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:04.539382 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:04.539643 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-6843bbd2-6636-4d45-b8dd-6ff427fbf371 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:22:04.660714 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Deleting port 9e2fce9e-f633-4191-bef6-3f55624776ad {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:22:04.661062 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:04.726201 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-6843bbd2-6636-4d45-b8dd-6ff427fbf371 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172'}], 'enable_snat': True}, 'gw_port_id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:22:03Z', 'revision_number': 5, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port': {'id': '9e2fce9e-f633-4191-bef6-3f55624776ad', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:c5:dc:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'device_owner': 'network:router_gateway', 'standard_attr_id': 41, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.172', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:15:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:22:04.741863 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] For port 9e2fce9e-f633-4191-bef6-3f55624776ad, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9e2fce9e-f633-4191-bef6-3f55624776ad,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:22:04.742241 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:04.754403 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6843bbd2-6636-4d45-b8dd-6ff427fbf371 None None] Checking router: 7bb4df85-5735-4ea8-9136-d2387a677310 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:22:04.756278 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Calling delete_port for 9e2fce9e-f633-4191-bef6-3f55624776ad owned by network:router_gateway {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:22:04.763986 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6843bbd2-6636-4d45-b8dd-6ff427fbf371 None None] Routers {'7bb4df85-5735-4ea8-9136-d2387a677310'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:22:04.764605 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-6843bbd2-6636-4d45-b8dd-6ff427fbf371 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:21:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['7bb4df85-5735-4ea8-9136-d2387a677310'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:22:04.854383 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-6843bbd2-6636-4d45-b8dd-6ff427fbf371 None None] Set router 7bb4df85-5735-4ea8-9136-d2387a677310 gateway port host: None {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:22:04.907152 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-6843bbd2-6636-4d45-b8dd-6ff427fbf371 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:22:04Z', 'revision_number': 6, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port_host': None}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:22:04.936888 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6843bbd2-6636-4d45-b8dd-6ff427fbf371 None None] The sync data for ids ['7bb4df85-5735-4ea8-9136-d2387a677310'] in dv-cinder-804035-18-iscsi is: [{'id': '7bb4df85-5735-4ea8-9136-d2387a677310', 'name': 'tempest-AttachVolumeShelveTestJSON-1854725999-router', 'tenant_id': '70ea7b83799640618db2c87847a8ecea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:14:55Z', 'updated_at': '2021-11-24T11:22:04Z', 'revision_number': 6, 'project_id': '70ea7b83799640618db2c87847a8ecea', 'gw_port_host': None}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:22:05.019580 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:05.048805 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Pushing event deleted for resources: {'Port': ['ID=9e2fce9e-f633-4191-bef6-3f55624776ad,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:05.109661 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-942710'] for router_gateway, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:05.212431 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1010955', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-663'] for router, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:05.214552 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:05.476911 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1010962'] for router, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:05.477542 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7bb4df85-5735-4ea8-9136-d2387a677310 {{(pid=103243) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 11:22:05.483157 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] Publish callbacks [] for router, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:05.484363 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-fee81d19-f82e-43bc-89b7-8d10f61d9489 admin admin] 10.222.0.76 "DELETE /v2.0/routers/7bb4df85-5735-4ea8-9136-d2387a677310 HTTP/1.1" status: 204 len: 168 time: 1.1626222 Nov 24 11:22:05.486861 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60992) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:05.531571 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_v2 [None req-e7955a58-0864-4145-855c-ab250d399626 admin admin] Deleting subnet 5eae2e87-935a-45b7-89da-586ce04ad644 {{(pid=103243) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:22:05.534718 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e7955a58-0864-4145-855c-ab250d399626 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:05.571184 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e7955a58-0864-4145-855c-ab250d399626 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-9292937'] for subnet, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:05.680880 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e7955a58-0864-4145-855c-ab250d399626 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:05.697844 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 1b6f5e32-07ed-47f9-a43d-ab92febf678e no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:22:05.720065 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 1b6f5e32-07ed-47f9-a43d-ab92febf678e {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:22:05.720636 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 1b6f5e32-07ed-47f9-a43d-ab92febf678e not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:22:05.814286 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e7955a58-0864-4145-855c-ab250d399626 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8721838', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9106635'] for subnet, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:05.838821 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7955a58-0864-4145-855c-ab250d399626 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5eae2e87-935a-45b7-89da-586ce04ad644,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:05.845137 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-e7955a58-0864-4145-855c-ab250d399626 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:05.851237 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-e7955a58-0864-4145-855c-ab250d399626 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/5eae2e87-935a-45b7-89da-586ce04ad644 HTTP/1.1" status: 204 len: 168 time: 0.3609393 Nov 24 11:22:05.851639 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 60998) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:05.853846 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d640720-43da-427d-b051-19ad16b245b1 None None] Network 76fcee22-81e5-4608-a546-3b68c56c5ac7 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:22:05.928892 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:05.987212 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Deleting port 6ff81879-9cc7-46c5-824f-661a525a56bd {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:22:05.987580 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:06.049677 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f19b3f41-9e4e-4f28-8f79-c84762a45948 None None] DHCP port deletion for 76fcee22-81e5-4608-a546-3b68c56c5ac7 request from dv-cinder-804035-18-iscsi {{(pid=103245) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 11:22:06.060420 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] For port 6ff81879-9cc7-46c5-824f-661a525a56bd, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=6ff81879-9cc7-46c5-824f-661a525a56bd,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:22:06.060785 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:06.073256 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Calling delete_port for 6ff81879-9cc7-46c5-824f-661a525a56bd owned by network:dhcp {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:22:06.101225 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-f19b3f41-9e4e-4f28-8f79-c84762a45948 None None] Deleting port 6ff81879-9cc7-46c5-824f-661a525a56bd {{(pid=103245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:22:06.101599 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f19b3f41-9e4e-4f28-8f79-c84762a45948 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:06.163844 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-f19b3f41-9e4e-4f28-8f79-c84762a45948 None None] For port 6ff81879-9cc7-46c5-824f-661a525a56bd, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=6ff81879-9cc7-46c5-824f-661a525a56bd,segment=NetworkSegment(82d2fb61-1d5d-4699-8932-ea33f5f3dc2b),segment_id=82d2fb61-1d5d-4699-8932-ea33f5f3dc2b)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:22:06.164241 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f19b3f41-9e4e-4f28-8f79-c84762a45948 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:06.176326 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-f19b3f41-9e4e-4f28-8f79-c84762a45948 None None] Calling delete_port for 6ff81879-9cc7-46c5-824f-661a525a56bd owned by network:dhcp {{(pid=103245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:22:06.265435 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:06.293075 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Pushing event deleted for resources: {'Port': ['ID=6ff81879-9cc7-46c5-824f-661a525a56bd,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:06.296928 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] No DVR routers for this DVR port 6ff81879-9cc7-46c5-824f-661a525a56bd on host dv-cinder-804035-18-iscsi {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:22:06.374454 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:06.384477 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f19b3f41-9e4e-4f28-8f79-c84762a45948 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:06.394636 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['76fcee22-81e5-4608-a546-3b68c56c5ac7']}} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:22:06.403942 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b') {'for_net_delete': True} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:22:06.404240 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '82d2fb61-1d5d-4699-8932-ea33f5f3dc2b') {} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:22:06.409157 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f19b3f41-9e4e-4f28-8f79-c84762a45948 None None] Pushing event deleted for resources: {'Port': ['ID=6ff81879-9cc7-46c5-824f-661a525a56bd,revision_number=None']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:06.412565 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f19b3f41-9e4e-4f28-8f79-c84762a45948 None None] No DVR routers for this DVR port 6ff81879-9cc7-46c5-824f-661a525a56bd on host dv-cinder-804035-18-iscsi {{(pid=103245) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:22:06.415415 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-9292944'] for segment, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:06.431441 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:06.438234 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Releasing vlan 1229 on physical network physnet1 to pool {{(pid=103243) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:22:06.438643 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8721920'] for segment, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: Traceback (most recent call last): Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: timer() Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: cb(*args, **kw) Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: return func(*args, **kwargs) Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: self._notify() Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: self.callback(batched_events) Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: event.method(event) Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: return f(self, *a, **k) Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._get(url).json() Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: return self.request(url, 'GET', **kwargs) Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:22:06.440370 dv-cinder-804035-18-iscsi neutron-server[103243]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:22:06.554657 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:06.560031 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:06.564101 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] 10.222.0.76 "DELETE /v2.0/networks/76fcee22-81e5-4608-a546-3b68c56c5ac7 HTTP/1.1" status: 204 len: 168 time: 0.7109246 Nov 24 11:22:06.573933 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80333593-f6c7-4da2-8f19-1496eaf4a27e admin admin] Pushing event deleted for resources: {'Network': ['ID=76fcee22-81e5-4608-a546-3b68c56c5ac7,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:06.973493 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 32776) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:07.012975 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-a6e8f731-aa9b-4f72-b4a8-25755112bcdf admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=70ea7b83799640618db2c87847a8ecea&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0382736 Nov 24 11:22:07.015637 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 32778) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:07.061935 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-9ab27b19-32a3-49b6-96f5-552b5e64869d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:07.082830 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-9ab27b19-32a3-49b6-96f5-552b5e64869d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:07.225454 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-9ab27b19-32a3-49b6-96f5-552b5e64869d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:07.228199 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-9ab27b19-32a3-49b6-96f5-552b5e64869d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:07.229412 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-9ab27b19-32a3-49b6-96f5-552b5e64869d admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/81469fbe-dad0-4d00-a4bc-8241ae461749 HTTP/1.1" status: 204 len: 168 time: 0.2128780 Nov 24 11:22:07.238312 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ab27b19-32a3-49b6-96f5-552b5e64869d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81469fbe-dad0-4d00-a4bc-8241ae461749,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:07.280994 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9e2fce9e-f633-4191-bef6-3f55624776ad no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:22:07.301395 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 9e2fce9e-f633-4191-bef6-3f55624776ad {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:22:07.301830 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9e2fce9e-f633-4191-bef6-3f55624776ad not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:22:07.302322 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 6ff81879-9cc7-46c5-824f-661a525a56bd no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:22:07.322720 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 6ff81879-9cc7-46c5-824f-661a525a56bd {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:22:07.323072 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 6ff81879-9cc7-46c5-824f-661a525a56bd not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:22:08.745207 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-1ad85f46-edbe-484b-baa3-1932a2ddb827 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:09.217561 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:10.381585 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 32852) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:10.487473 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8b88a242-58b9-43a3-a2cd-6b6fb812ff80 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:10.560890 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8b88a242-58b9-43a3-a2cd-6b6fb812ff80 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:10.636789 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8b88a242-58b9-43a3-a2cd-6b6fb812ff80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:10.674975 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-8b88a242-58b9-43a3-a2cd-6b6fb812ff80 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=529f0d1909454a9a8d64e88ce11fbc9c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2923138 Nov 24 11:22:10.676127 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b88a242-58b9-43a3-a2cd-6b6fb812ff80 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4981302-55de-47e1-9fd6-a447a6ae4552,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:10.678063 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 32856) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:10.725784 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2318e54d-b7c7-48db-91b7-faf72c9c4dc9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:10.748284 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2318e54d-b7c7-48db-91b7-faf72c9c4dc9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:10.869413 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2318e54d-b7c7-48db-91b7-faf72c9c4dc9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:10.872193 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2318e54d-b7c7-48db-91b7-faf72c9c4dc9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:10.873401 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2318e54d-b7c7-48db-91b7-faf72c9c4dc9 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/d4981302-55de-47e1-9fd6-a447a6ae4552 HTTP/1.1" status: 204 len: 168 time: 0.1947529 Nov 24 11:22:10.881906 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2318e54d-b7c7-48db-91b7-faf72c9c4dc9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4981302-55de-47e1-9fd6-a447a6ae4552,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:11.178340 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d970f2fa-ae81-4518-a009-b80d5a55641c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:11.500601 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 32866) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:11.515348 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-502f6312-e038-4fcb-98b6-2c1c98620629 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:11.592525 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-502f6312-e038-4fcb-98b6-2c1c98620629 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:11.675837 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-502f6312-e038-4fcb-98b6-2c1c98620629 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:11.717568 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-502f6312-e038-4fcb-98b6-2c1c98620629 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=bc15637a0c7545a99cf4092e15abea09&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2158935 Nov 24 11:22:11.718924 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-502f6312-e038-4fcb-98b6-2c1c98620629 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=43f0cad6-0d74-46fb-99ff-86e24b5e9373,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:11.720381 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 32876) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:22:11.770724 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ce9d8d1-22a5-4f5a-bd70-e2a7a2f92bba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:11.793521 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ce9d8d1-22a5-4f5a-bd70-e2a7a2f92bba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:11.910729 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ce9d8d1-22a5-4f5a-bd70-e2a7a2f92bba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:11.913462 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ce9d8d1-22a5-4f5a-bd70-e2a7a2f92bba admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:11.914751 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-8ce9d8d1-22a5-4f5a-bd70-e2a7a2f92bba admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/43f0cad6-0d74-46fb-99ff-86e24b5e9373 HTTP/1.1" status: 204 len: 168 time: 0.1922507 Nov 24 11:22:11.922536 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ce9d8d1-22a5-4f5a-bd70-e2a7a2f92bba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=43f0cad6-0d74-46fb-99ff-86e24b5e9373,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:12.488339 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:14.080224 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:14.813466 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:20.548535 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b1947c5-9386-4527-ba77-38d0e9aa7bf7 req-f19b6a96-438a-4a9f-840a-f80579d96add tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:20.550062 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2b1947c5-9386-4527-ba77-38d0e9aa7bf7 req-f19b6a96-438a-4a9f-840a-f80579d96add tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0529389 Nov 24 11:22:20.604562 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2b1947c5-9386-4527-ba77-38d0e9aa7bf7 req-50c01004-f0c3-421e-857a-23c4faf501cc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476894 Nov 24 11:22:21.722584 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d83781c-9224-40f5-b216-038a4f53e082 req-b02f66b7-0efd-4ad2-a45a-070e3efa0717 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:21.724090 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2d83781c-9224-40f5-b216-038a4f53e082 req-b02f66b7-0efd-4ad2-a45a-070e3efa0717 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0485473 Nov 24 11:22:21.776921 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2d83781c-9224-40f5-b216-038a4f53e082 req-0dfb18e0-e370-4dcc-b342-17d0755f6d02 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469699 Nov 24 11:22:22.073105 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:22:22.896304 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf6e724-2ab0-4dcd-aa96-1e3d62cb050b req-0e61d915-f0b2-414d-83b5-ed19a1c84062 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:22.897968 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-adf6e724-2ab0-4dcd-aa96-1e3d62cb050b req-0e61d915-f0b2-414d-83b5-ed19a1c84062 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0531685 Nov 24 11:22:22.950439 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-adf6e724-2ab0-4dcd-aa96-1e3d62cb050b req-8248a2f1-b55a-4bea-91af-5fc645a5fa9a tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465529 Nov 24 11:22:24.072240 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2209972-1a7b-4d44-9839-6cec1389a75c req-f79c30d1-62dc-4b03-9402-995aa7e8f6de tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:24.073684 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d2209972-1a7b-4d44-9839-6cec1389a75c req-f79c30d1-62dc-4b03-9402-995aa7e8f6de tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0530407 Nov 24 11:22:24.124963 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d2209972-1a7b-4d44-9839-6cec1389a75c req-6cab7c33-82d9-40ba-a242-e5829adbcb2e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452094 Nov 24 11:22:25.240641 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-914dec6a-4d91-45d9-a5ed-4ae8ab2c5ddf req-fd3cca91-b81e-4934-86a9-cd00a19bf25e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:25.242116 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-914dec6a-4d91-45d9-a5ed-4ae8ab2c5ddf req-fd3cca91-b81e-4934-86a9-cd00a19bf25e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0503085 Nov 24 11:22:25.291916 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-914dec6a-4d91-45d9-a5ed-4ae8ab2c5ddf req-6c1bdba4-8e69-43bf-8f3c-9d74ee0220c7 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439687 Nov 24 11:22:26.413545 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5acd2092-e71c-4952-b853-f4d491106aea req-2908aaae-5f20-4427-bd80-8e1bf8700de0 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:26.415009 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5acd2092-e71c-4952-b853-f4d491106aea req-2908aaae-5f20-4427-bd80-8e1bf8700de0 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0545707 Nov 24 11:22:26.469042 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5acd2092-e71c-4952-b853-f4d491106aea req-f9352218-1cec-40cf-b083-84fecb2c4482 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482221 Nov 24 11:22:27.595056 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-392a3f1c-7803-41d7-a85a-8c0edcc40646 req-52bf7028-1316-43c8-8b56-f97d19dd43d1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:27.596956 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-392a3f1c-7803-41d7-a85a-8c0edcc40646 req-52bf7028-1316-43c8-8b56-f97d19dd43d1 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0490694 Nov 24 11:22:27.648772 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-392a3f1c-7803-41d7-a85a-8c0edcc40646 req-2dbb0009-64b8-4541-83b2-05847688e8f4 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444393 Nov 24 11:22:28.765849 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfa83bfb-6810-43d9-8ec8-e639ce266800 req-3fc397eb-7ceb-48a1-a237-b14a5ea1c181 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:28.767320 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bfa83bfb-6810-43d9-8ec8-e639ce266800 req-3fc397eb-7ceb-48a1-a237-b14a5ea1c181 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0512216 Nov 24 11:22:28.819617 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bfa83bfb-6810-43d9-8ec8-e639ce266800 req-32eae009-43ee-4d84-8d36-f1f4ff725c6d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456131 Nov 24 11:22:29.936140 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b21cce-fcb1-473e-8931-3ded3222861d req-278ee550-0f50-4ff2-8432-1156d32cc741 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:29.937582 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-31b21cce-fcb1-473e-8931-3ded3222861d req-278ee550-0f50-4ff2-8432-1156d32cc741 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0488944 Nov 24 11:22:29.986345 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-31b21cce-fcb1-473e-8931-3ded3222861d req-09d9c0f9-3315-4dcb-b909-d78475e1511d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427873 Nov 24 11:22:30.809484 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b23a70d-2002-415f-ae72-df99f65fe181 req-a91049db-8b24-4e9e-a57c-5f9eb94b0ffe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:30.810945 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4b23a70d-2002-415f-ae72-df99f65fe181 req-a91049db-8b24-4e9e-a57c-5f9eb94b0ffe service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=89e9b1abd4814b03ae8c95c5918bef03&device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 1098 time: 0.0468905 Nov 24 11:22:30.901014 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b23a70d-2002-415f-ae72-df99f65fe181 req-cf611a65-7c44-4666-b195-86f0e70b8663 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:30.902350 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4b23a70d-2002-415f-ae72-df99f65fe181 req-cf611a65-7c44-4666-b195-86f0e70b8663 service neutron] 10.222.0.86 "GET /v2.0/networks?id=6b81a015-9685-4892-8d78-2a713f48dc53 HTTP/1.1" status: 200 len: 911 time: 0.0825105 Nov 24 11:22:30.969802 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4b23a70d-2002-415f-ae72-df99f65fe181 req-23627c0c-cabb-4edf-ae0a-f6454a1b00de service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d HTTP/1.1" status: 200 len: 1001 time: 0.0594974 Nov 24 11:22:31.018863 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b23a70d-2002-415f-ae72-df99f65fe181 req-c479d9b9-df5d-441d-b649-2e6872fe4121 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:31.020326 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4b23a70d-2002-415f-ae72-df99f65fe181 req-c479d9b9-df5d-441d-b649-2e6872fe4121 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c HTTP/1.1" status: 200 len: 848 time: 0.0420783 Nov 24 11:22:31.067012 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b23a70d-2002-415f-ae72-df99f65fe181 req-c88fddf7-d0bb-4ae2-84c4-f08a5528feab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:31.069067 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4b23a70d-2002-415f-ae72-df99f65fe181 req-c88fddf7-d0bb-4ae2-84c4-f08a5528feab service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b81a015-9685-4892-8d78-2a713f48dc53&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0410211 Nov 24 11:22:31.102529 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-051939e6-33a3-4d88-8e19-1b5ef5899edc req-c62875d7-18c0-483c-943b-df3b006892f3 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:31.104169 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-051939e6-33a3-4d88-8e19-1b5ef5899edc req-c62875d7-18c0-483c-943b-df3b006892f3 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0498910 Nov 24 11:22:31.156802 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-051939e6-33a3-4d88-8e19-1b5ef5899edc req-f0c35a72-9d78-4b43-809a-08b73f6fd584 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468135 Nov 24 11:22:31.162672 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4b23a70d-2002-415f-ae72-df99f65fe181 req-f194cea3-6479-48ea-8013-bfcade810c28 service neutron] 10.222.0.86 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858119 Nov 24 11:22:31.252517 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4b23a70d-2002-415f-ae72-df99f65fe181 req-2cb89bbc-4b12-4705-ba15-2b22c00667ee service neutron] 10.222.0.86 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0813124 Nov 24 11:22:32.269637 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64f77592-9a53-444a-b029-350ee2feb971 req-c966ce9c-b1b2-4502-89a8-ca339fd7b668 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:32.271235 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-64f77592-9a53-444a-b029-350ee2feb971 req-c966ce9c-b1b2-4502-89a8-ca339fd7b668 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0482221 Nov 24 11:22:32.320458 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-64f77592-9a53-444a-b029-350ee2feb971 req-27aa791b-250f-4dec-8782-c30794ddaea7 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433116 Nov 24 11:22:33.438767 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09aea4ba-3399-4697-a99f-09cfce35bedb req-cb312749-64d7-4c79-9cae-70daadeca76c tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:33.440249 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-09aea4ba-3399-4697-a99f-09cfce35bedb req-cb312749-64d7-4c79-9cae-70daadeca76c tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0514302 Nov 24 11:22:33.489967 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-09aea4ba-3399-4697-a99f-09cfce35bedb req-e2bdbd29-7590-4fca-8a74-722f6032875a tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435770 Nov 24 11:22:34.610564 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01f810c8-ee54-44b0-84e6-0cb7b5469ab8 req-48ded498-ba52-48e8-96f4-520cb3007343 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:34.611927 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-01f810c8-ee54-44b0-84e6-0cb7b5469ab8 req-48ded498-ba52-48e8-96f4-520cb3007343 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0548201 Nov 24 11:22:34.661675 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-01f810c8-ee54-44b0-84e6-0cb7b5469ab8 req-1b05c14b-00c8-4618-9479-17a6f2616c5c tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426986 Nov 24 11:22:34.979879 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dad8e0d-ad7f-4680-9dec-a2e0f2aa2892 req-72224ff5-9774-4150-abff-c8fcac176afc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:34.981337 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7dad8e0d-ad7f-4680-9dec-a2e0f2aa2892 req-72224ff5-9774-4150-abff-c8fcac176afc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0486445 Nov 24 11:22:35.045810 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-cde97d3b-5c98-4981-9058-3e2fe9f8fb10 service neutron] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0634432 Nov 24 11:22:35.059159 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7dad8e0d-ad7f-4680-9dec-a2e0f2aa2892 req-7b54f3f5-0346-491c-8783-8a30875bb540 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0696888 Nov 24 11:22:36.174236 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46ef8851-0672-479c-9dc2-4877227736d5 req-cccbc07b-b0b9-4672-9a88-6fe878af42f5 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:36.175716 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-46ef8851-0672-479c-9dc2-4877227736d5 req-cccbc07b-b0b9-4672-9a88-6fe878af42f5 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0492606 Nov 24 11:22:36.224240 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-46ef8851-0672-479c-9dc2-4877227736d5 req-efe6a358-0a9a-471a-b1a7-3f0b58560e3e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427241 Nov 24 11:22:37.301769 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 4309383c-b778-44aa-bd64-d0a29f77fb4d no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:22:37.340259 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c966ef44-72c0-4dd4-a090-6d5197990636 req-090c9ae2-d9ac-4534-8564-2be34b29c3d0 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:37.341812 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c966ef44-72c0-4dd4-a090-6d5197990636 req-090c9ae2-d9ac-4534-8564-2be34b29c3d0 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0532584 Nov 24 11:22:37.389693 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:37.396932 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c966ef44-72c0-4dd4-a090-6d5197990636 req-ad534ec4-982c-42d0-a6eb-e59ab281db78 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431633 Nov 24 11:22:37.413191 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:22:37.415631 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14b3415a-c823-4d47-a2cd-d2ae88e69743" -d '{"events": [{"server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "name": "network-vif-unplugged", "status": "completed", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:22:37.429158 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 4309383c-b778-44aa-bd64-d0a29f77fb4d, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:22:37.448671 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Wed, 24 Nov 2021 11:22:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-328d3a74-48cc-4900-8d1f-e9528fbdf5af x-openstack-request-id: req-328d3a74-48cc-4900-8d1f-e9528fbdf5af {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:22:37.448962 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "name": "network-vif-unplugged", "status": "failed", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d", "code": 422}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:22:37.449218 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-328d3a74-48cc-4900-8d1f-e9528fbdf5af {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:22:37.449618 dv-cinder-804035-18-iscsi neutron-server[103245]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'code': 422} returned with failed status Nov 24 11:22:37.508770 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:37.557482 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=4309383c-b778-44aa-bd64-d0a29f77fb4d,revision_number=6']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:38.525614 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eacddae-4139-473f-82be-8722052bb402 req-87e61d25-dc1c-4639-ad1c-1e920eda67f4 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:38.527239 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0eacddae-4139-473f-82be-8722052bb402 req-87e61d25-dc1c-4639-ad1c-1e920eda67f4 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0542362 Nov 24 11:22:38.576124 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0eacddae-4139-473f-82be-8722052bb402 req-266f1b99-017a-42c0-b337-99da768abf0f tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428679 Nov 24 11:22:38.748650 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fc8f1e58-e942-4c2a-89ee-50d2bb8b5c80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:39.190413 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:39.689113 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2112cf22-0b0e-4b16-a449-5ad239feb502 req-ecd31685-378b-4a95-8120-74ce437b3199 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:39.690576 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2112cf22-0b0e-4b16-a449-5ad239feb502 req-ecd31685-378b-4a95-8120-74ce437b3199 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0484421 Nov 24 11:22:39.739831 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2112cf22-0b0e-4b16-a449-5ad239feb502 req-3ff94e9b-83da-448d-bce0-c643bc6a6b2a tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427551 Nov 24 11:22:40.855454 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65093782-50a5-4e9b-b26c-88810a52af13 req-1adffb82-cb85-4e5c-b9d8-671be3a69798 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:40.856941 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-65093782-50a5-4e9b-b26c-88810a52af13 req-1adffb82-cb85-4e5c-b9d8-671be3a69798 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0488129 Nov 24 11:22:40.908871 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-65093782-50a5-4e9b-b26c-88810a52af13 req-51fbd9b0-9446-4a08-ba8c-d0194ad9ae60 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460322 Nov 24 11:22:41.148172 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-bf28caad-1a60-4b7f-b13e-e4740c54afde None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:42.022573 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97f47f0f-896c-4672-9f26-d2b439fa1ca0 req-5ee43435-5ec4-4a4d-8cde-044099d203ce tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:42.024064 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-97f47f0f-896c-4672-9f26-d2b439fa1ca0 req-5ee43435-5ec4-4a4d-8cde-044099d203ce tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0489821 Nov 24 11:22:42.071792 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-97f47f0f-896c-4672-9f26-d2b439fa1ca0 req-602d7412-7d07-4916-b363-d637e13cb078 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419569 Nov 24 11:22:42.473945 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:43.183136 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54bc4fc2-b555-44f6-ab0e-e8e32bebd03f req-2c899202-f09a-4c55-bb24-d7d3e078ecd2 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:43.184627 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-54bc4fc2-b555-44f6-ab0e-e8e32bebd03f req-2c899202-f09a-4c55-bb24-d7d3e078ecd2 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0478151 Nov 24 11:22:43.234690 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-54bc4fc2-b555-44f6-ab0e-e8e32bebd03f req-794e69cb-c7e4-498c-901a-24e80c847cbd tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442231 Nov 24 11:22:44.074143 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:44.362936 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b77880-d483-42f5-b046-64a25b793914 req-d1f48ac2-b678-46c5-bddb-a50bbaea4b1e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:44.364414 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b1b77880-d483-42f5-b046-64a25b793914 req-d1f48ac2-b678-46c5-bddb-a50bbaea4b1e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0525413 Nov 24 11:22:44.414455 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b1b77880-d483-42f5-b046-64a25b793914 req-e4717161-7d17-41f5-8210-c5cfed316cad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435555 Nov 24 11:22:44.800159 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:45.529250 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f3e6dc0-871b-4c1d-8129-dab2ba553db4 req-cee5f959-6780-4233-bbb0-28073443c484 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:45.530859 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0f3e6dc0-871b-4c1d-8129-dab2ba553db4 req-cee5f959-6780-4233-bbb0-28073443c484 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0506327 Nov 24 11:22:45.585454 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0f3e6dc0-871b-4c1d-8129-dab2ba553db4 req-7386e922-b0d3-45c7-8e76-c2db4851e185 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485125 Nov 24 11:22:46.449350 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-baba936f-77b0-4340-82fc-f9da790ce8ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:46.450853 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-baba936f-77b0-4340-82fc-f9da790ce8ca service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50&tenant_id=89e9b1abd4814b03ae8c95c5918bef03 HTTP/1.1" status: 200 len: 1096 time: 0.0468750 Nov 24 11:22:46.515422 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-b0f0c7b5-60e8-4943-b649-82d4db73c6e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:46.516956 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-b0f0c7b5-60e8-4943-b649-82d4db73c6e2 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=89e9b1abd4814b03ae8c95c5918bef03&device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 1096 time: 0.0434146 Nov 24 11:22:46.606274 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-9583213a-8fbe-4cea-a5eb-14a7c0b134ed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:46.607750 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-9583213a-8fbe-4cea-a5eb-14a7c0b134ed service neutron] 10.222.0.86 "GET /v2.0/networks?id=6b81a015-9685-4892-8d78-2a713f48dc53 HTTP/1.1" status: 200 len: 911 time: 0.0836432 Nov 24 11:22:46.678381 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-68fead4d-9d11-4fd6-92e1-bfed500db25f service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d HTTP/1.1" status: 200 len: 999 time: 0.0636590 Nov 24 11:22:46.715586 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36704813-347f-4caa-8444-16906a6ad56f req-dd990de0-51a2-4178-9de4-61099ef906e3 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:46.727999 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-36704813-347f-4caa-8444-16906a6ad56f req-dd990de0-51a2-4178-9de4-61099ef906e3 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0744178 Nov 24 11:22:46.738222 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-09284172-cbdd-40bd-8742-ecafb4539da7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:46.740003 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-09284172-cbdd-40bd-8742-ecafb4539da7 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c HTTP/1.1" status: 200 len: 848 time: 0.0546153 Nov 24 11:22:46.791027 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-b6485485-25c2-4b1b-bbff-344780dbe157 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:46.793089 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-b6485485-25c2-4b1b-bbff-344780dbe157 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b81a015-9685-4892-8d78-2a713f48dc53&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0459096 Nov 24 11:22:46.798150 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-36704813-347f-4caa-8444-16906a6ad56f req-2cbe3286-c6a0-4766-83f2-49e01852796a tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0633624 Nov 24 11:22:46.891095 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-d25eb9b2-5644-4659-8e0a-21b60b20d58f service neutron] 10.222.0.86 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0894578 Nov 24 11:22:46.986544 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-036e2865-94f7-441e-b991-8a9c17199bd9 service neutron] 10.222.0.86 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870168 Nov 24 11:22:47.916269 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25690991-78e9-40ba-b69b-74e1705cb83c req-db6c8f18-c415-4e07-a692-315c1106a04f tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:47.917758 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-25690991-78e9-40ba-b69b-74e1705cb83c req-db6c8f18-c415-4e07-a692-315c1106a04f tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0500016 Nov 24 11:22:47.967992 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-25690991-78e9-40ba-b69b-74e1705cb83c req-8ecbf997-db5b-4657-9a8e-fd97af9c91a7 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441234 Nov 24 11:22:49.086436 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53dd5e41-5ede-4d98-8fa4-9cf46d466978 req-fef178d5-3175-4a8d-80a4-41f473a0e8a4 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:49.088024 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-53dd5e41-5ede-4d98-8fa4-9cf46d466978 req-fef178d5-3175-4a8d-80a4-41f473a0e8a4 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0532494 Nov 24 11:22:49.148686 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-53dd5e41-5ede-4d98-8fa4-9cf46d466978 req-a8074198-93fd-446d-ac41-c58fbfa28572 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0541813 Nov 24 11:22:50.263886 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f4e3911-c382-4878-899b-8ff8a4818aef req-cedb6252-dd12-4cb1-ab53-d35b5a89ea20 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:50.265317 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3f4e3911-c382-4878-899b-8ff8a4818aef req-cedb6252-dd12-4cb1-ab53-d35b5a89ea20 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0479562 Nov 24 11:22:50.313678 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3f4e3911-c382-4878-899b-8ff8a4818aef req-a6cd3e97-d779-43ed-83c2-c519b57bd68e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425029 Nov 24 11:22:51.428009 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16a5896e-d4c9-47a5-8f9e-fcda97207b79 req-547c07d3-4a6c-4f2a-93dd-617e4e187724 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:51.430218 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-16a5896e-d4c9-47a5-8f9e-fcda97207b79 req-547c07d3-4a6c-4f2a-93dd-617e4e187724 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0486126 Nov 24 11:22:51.479587 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-16a5896e-d4c9-47a5-8f9e-fcda97207b79 req-577544dd-3ae4-4e92-a983-f53d65c9fcb4 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433216 Nov 24 11:22:52.601117 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f491f05-b62d-4e57-a374-9725a296af63 req-41e0c4c8-cf55-41e7-b3ca-fe5f8cbcc919 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:52.602594 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6f491f05-b62d-4e57-a374-9725a296af63 req-41e0c4c8-cf55-41e7-b3ca-fe5f8cbcc919 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0536351 Nov 24 11:22:52.653206 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6f491f05-b62d-4e57-a374-9725a296af63 req-6b562164-bcaa-4260-a6a2-5d6a1018761a tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447707 Nov 24 11:22:53.766065 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61a51838-763e-46c1-8a7b-48e50351fef5 req-9b5a9712-f72e-4c2b-9bd4-2fcd68c85d01 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:53.767535 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-61a51838-763e-46c1-8a7b-48e50351fef5 req-9b5a9712-f72e-4c2b-9bd4-2fcd68c85d01 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0477223 Nov 24 11:22:53.817481 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-61a51838-763e-46c1-8a7b-48e50351fef5 req-ec772fdd-9f56-491a-8f16-61f51d595761 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434470 Nov 24 11:22:54.930267 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd738c31-48f1-42fa-b656-b2d16383e930 req-49a9742e-3f2f-468b-add5-1bae4503f8bb tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:54.931722 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dd738c31-48f1-42fa-b656-b2d16383e930 req-49a9742e-3f2f-468b-add5-1bae4503f8bb tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0475576 Nov 24 11:22:54.982662 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dd738c31-48f1-42fa-b656-b2d16383e930 req-db01b0d0-a275-4e79-8fe2-20c08992e8b2 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450864 Nov 24 11:22:55.862061 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 4309383c-b778-44aa-bd64-d0a29f77fb4d details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:22:55.954840 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 4309383c-b778-44aa-bd64-d0a29f77fb4d, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:22:55.967404 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'port_id': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'mac_address': 'fa:16:3e:2f:0e:bb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1239, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:22:56.008100 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:56.021373 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4309383c-b778-44aa-bd64-d0a29f77fb4d {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:22:56.042524 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 4309383c-b778-44aa-bd64-d0a29f77fb4d, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:22:56.099434 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3c06024-d53b-46c3-b1f0-4f2bd0f7dca3 req-40fe223d-6ee6-4263-a6eb-ac5ee29ef456 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:56.100974 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f3c06024-d53b-46c3-b1f0-4f2bd0f7dca3 req-40fe223d-6ee6-4263-a6eb-ac5ee29ef456 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 943 time: 0.0498168 Nov 24 11:22:56.108558 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:56.151562 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f3c06024-d53b-46c3-b1f0-4f2bd0f7dca3 req-8f454e10-313a-4a7c-b503-370c367bb00e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445168 Nov 24 11:22:56.158637 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=4309383c-b778-44aa-bd64-d0a29f77fb4d,revision_number=7']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:56.166697 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:22:56.170063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:22:56.170063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:22:56.170063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:22:56.170063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:22:56.170063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:22:56.170063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:22:56.170063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:22:56.170063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:22:56.170063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:22:56.170063 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:22:56.170835 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:22:56.334021 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['4309383c-b778-44aa-bd64-d0a29f77fb4d'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:22:57.278562 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-092acdc7-c62c-4cf8-a9a9-6130dedd4fbc req-e8435749-8d43-4aa2-a371-6d9635f1785e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:57.280209 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-092acdc7-c62c-4cf8-a9a9-6130dedd4fbc req-e8435749-8d43-4aa2-a371-6d9635f1785e tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 944 time: 0.0486228 Nov 24 11:22:57.329761 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-092acdc7-c62c-4cf8-a9a9-6130dedd4fbc req-d461dae2-60d3-49f3-8db7-294a6d580070 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435367 Nov 24 11:22:57.380250 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 4309383c-b778-44aa-bd64-d0a29f77fb4d up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:22:57.430098 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 4309383c-b778-44aa-bd64-d0a29f77fb4d triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:22:57.430454 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:57.523659 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:57.546959 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:22:57.549306 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-15b71312-ca8d-43aa-9910-e235159650b2" -d '{"events": [{"server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "name": "network-vif-plugged", "status": "completed", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:22:57.563348 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 4309383c-b778-44aa-bd64-d0a29f77fb4d, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:22:57.587848 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:22:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3fb7a843-7da7-4b69-86ba-b4a145d97aed x-openstack-request-id: req-3fb7a843-7da7-4b69-86ba-b4a145d97aed {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:22:57.591930 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "name": "network-vif-plugged", "status": "completed", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:22:57.591930 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-3fb7a843-7da7-4b69-86ba-b4a145d97aed {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:22:57.591930 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'code': 200} Nov 24 11:22:57.668208 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:22:57.716202 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=4309383c-b778-44aa-bd64-d0a29f77fb4d,revision_number=8']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:22:57.886446 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0798374-d60b-40db-b7ce-284673769ba2 req-eaef578f-0cc7-403d-b745-51e9c4fdcbf5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:57.887981 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-f0798374-d60b-40db-b7ce-284673769ba2 req-eaef578f-0cc7-403d-b745-51e9c4fdcbf5 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 1098 time: 0.0459998 Nov 24 11:22:57.937478 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-f0798374-d60b-40db-b7ce-284673769ba2 req-480cc38b-011b-435e-9c8b-14db810a9f5b service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387089 Nov 24 11:22:58.450995 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be027f6-b69b-48d1-aec6-e4072adedfdb req-e26b1be5-4570-4b9b-acc0-84a01f0228bc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:58.452465 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6be027f6-b69b-48d1-aec6-e4072adedfdb req-e26b1be5-4570-4b9b-acc0-84a01f0228bc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0512779 Nov 24 11:22:58.499942 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6be027f6-b69b-48d1-aec6-e4072adedfdb req-844a2b14-7888-41f6-b789-350f7e783ae7 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416718 Nov 24 11:22:59.071856 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:22:59.615030 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d410af09-3435-40bc-9c39-abe9a6698a71 req-a7cf027b-ca12-42a7-a085-a0e2f084077f tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:22:59.616500 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d410af09-3435-40bc-9c39-abe9a6698a71 req-a7cf027b-ca12-42a7-a085-a0e2f084077f tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0482068 Nov 24 11:22:59.664707 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d410af09-3435-40bc-9c39-abe9a6698a71 req-8ae89321-4f2f-40d1-8b37-516d4d1e0b68 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417144 Nov 24 11:23:00.249763 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 33486) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:00.354722 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:00.429863 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:00.499243 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:00.543651 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=bee73d984c0843acb972147257e040e2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2927830 Nov 24 11:23:00.544599 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1305b73d-0301-40ac-b38f-561182381494,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:00.546479 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33502) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:00.552783 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.553780 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.554133 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.554475 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.554873 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.555851 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.556195 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.556533 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.556869 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.557203 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.557602 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.557959 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13e4574-27e4-4b67-b6d5-a6caf51c1fc7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.599618 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:00.623875 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:00.754147 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:00.756830 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:00.758639 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/1305b73d-0301-40ac-b38f-561182381494 HTTP/1.1" status: 204 len: 168 time: 0.2104976 Nov 24 11:23:00.766662 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1305b73d-0301-40ac-b38f-561182381494,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:00.774683 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.775030 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.775391 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.775726 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.776050 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.776374 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.776705 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.777025 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.777373 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.777778 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.778064 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:00.778422 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fbb7001-ea36-4752-b255-9de794f7c455 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:01.223975 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33520) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:01.327720 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6445fa5c-1c2f-487b-b0b0-66be1f217400 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:01.406431 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6445fa5c-1c2f-487b-b0b0-66be1f217400 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:01.491564 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6445fa5c-1c2f-487b-b0b0-66be1f217400 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:01.536154 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-6445fa5c-1c2f-487b-b0b0-66be1f217400 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=b228765e5f484fe89c0d7b0b7b85c6b4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3058856 Nov 24 11:23:01.536154 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6445fa5c-1c2f-487b-b0b0-66be1f217400 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d3f8adf1-2186-4ab5-aadf-2a150a7ced7f,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:01.537618 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33530) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:01.591352 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-01f7a19b-7619-4fb2-b170-39f1657ed666 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:01.614849 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-01f7a19b-7619-4fb2-b170-39f1657ed666 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:01.736889 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-01f7a19b-7619-4fb2-b170-39f1657ed666 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:01.739635 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-01f7a19b-7619-4fb2-b170-39f1657ed666 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:01.740926 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-01f7a19b-7619-4fb2-b170-39f1657ed666 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/d3f8adf1-2186-4ab5-aadf-2a150a7ced7f HTTP/1.1" status: 204 len: 168 time: 0.2024894 Nov 24 11:23:01.750776 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01f7a19b-7619-4fb2-b170-39f1657ed666 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3f8adf1-2186-4ab5-aadf-2a150a7ced7f,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:01.772628 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33540) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:01.869665 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1654858148-network', 'tenant_id': 'f3594395ceb848e1bcdcf0fa1a6f78b4'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:23:01.965082 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Made reservation on behalf of f3594395ceb848e1bcdcf0fa1a6f78b4 for: {'network': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:23:01.967488 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:01.976260 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.049194 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.134347 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.159539 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1235} {{(pid=103244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:23:02.169784 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=732f4c54-3fb7-459d-86f5-6a9c38558de9,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:02.174388 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.174743 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.segments_db [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Added segment d17edd0c-57ba-4458-9e65-d12987ea086d of type vlan for network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d Nov 24 11:23:02.213485 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.332623 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.332623 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:02.332623 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.391188 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] Pushing event updated for resources: {'Network': ['ID=256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:02.401596 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:23:02.423476 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33546) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:02.438881 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-4aae71ff-8241-48e0-96ad-219232bff54a admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.6644962 Nov 24 11:23:02.440101 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ce675623-2705-4192-b925-5102d6876d0b admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.442201 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 33548) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:02.447691 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-1341ee08-6503-48c1-9f79-35dd4080b4a0 admin admin] Request body: {'subnet': {'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1654858148-subnet', 'tenant_id': 'f3594395ceb848e1bcdcf0fa1a6f78b4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:23:02.514637 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ce675623-2705-4192-b925-5102d6876d0b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.527790 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1341ee08-6503-48c1-9f79-35dd4080b4a0 admin admin] Made reservation on behalf of f3594395ceb848e1bcdcf0fa1a6f78b4 for: {'subnet': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:23:02.530170 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1341ee08-6503-48c1-9f79-35dd4080b4a0 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9106670'] for subnet, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.582681 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ce675623-2705-4192-b925-5102d6876d0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.621948 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce675623-2705-4192-b925-5102d6876d0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f1c9a92-2bdd-4382-9c00-950a7067bbef,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:02.628843 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-ce675623-2705-4192-b925-5102d6876d0b admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=c137ac9efec34681b918ad8965499d8d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2017107 Nov 24 11:23:02.629260 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33550) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:02.677690 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6afe64d-758b-41e0-8901-761d3211d576 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.698529 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6afe64d-758b-41e0-8901-761d3211d576 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.754434 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1341ee08-6503-48c1-9f79-35dd4080b4a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8721775', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9106652'] for subnet, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.808012 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6afe64d-758b-41e0-8901-761d3211d576 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.810817 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e6afe64d-758b-41e0-8901-761d3211d576 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:02.812005 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-e6afe64d-758b-41e0-8901-761d3211d576 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/3f1c9a92-2bdd-4382-9c00-950a7067bbef HTTP/1.1" status: 204 len: 168 time: 0.1820178 Nov 24 11:23:02.812334 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1341ee08-6503-48c1-9f79-35dd4080b4a0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4c8f23cd-59c3-43ba-a990-3dfaf32f8cf7,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:02.822644 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6afe64d-758b-41e0-8901-761d3211d576 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f1c9a92-2bdd-4382-9c00-950a7067bbef,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:02.830113 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1341ee08-6503-48c1-9f79-35dd4080b4a0 admin admin] Checking segment: {'id': 'd17edd0c-57ba-4458-9e65-d12987ea086d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1235, 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:23:02.830343 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1341ee08-6503-48c1-9f79-35dd4080b4a0 admin admin] Network hostable DHCP agents. Network: 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103243) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:23:02.936496 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1341ee08-6503-48c1-9f79-35dd4080b4a0 admin admin] Network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103243) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:23:03.024723 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-1341ee08-6503-48c1-9f79-35dd4080b4a0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d) {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:23:03.029082 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1341ee08-6503-48c1-9f79-35dd4080b4a0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:03.029677 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1341ee08-6503-48c1-9f79-35dd4080b4a0 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:03.034336 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15f82647-d8e7-44f0-901d-b8be8cd00e47 None None] Network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:23:03.099687 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-1341ee08-6503-48c1-9f79-35dd4080b4a0 admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.6559980 Nov 24 11:23:03.159151 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26d7342e-112a-4064-ba27-c16404a5a58f None None] Network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:23:05.308296 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-ce533f7f-e049-4701-852b-aeb8c3aa6ce2 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:05.309659 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-ce533f7f-e049-4701-852b-aeb8c3aa6ce2 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/networks?id=256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d HTTP/1.1" status: 200 len: 814 time: 0.1042318 Nov 24 11:23:05.324671 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-a9baaf00-e034-4d33-8807-d839b9ba7ae5 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/quotas/f3594395ceb848e1bcdcf0fa1a6f78b4 HTTP/1.1" status: 200 len: 375 time: 0.0093620 Nov 24 11:23:05.357251 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-15d93397-0200-4077-8a39-9ea7696f63ba tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=f3594395ceb848e1bcdcf0fa1a6f78b4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0274444 Nov 24 11:23:05.449812 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-deeb34b9-7eca-45ce-9aa9-6a6aeb9890fc service neutron] 10.222.0.76 "GET /v2.0/networks/256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855033 Nov 24 11:23:05.538153 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-627c8751-7ad9-40f6-8dad-fadc0abfc3cb service neutron] 10.222.0.76 "GET /v2.0/networks/256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822544 Nov 24 11:23:06.805266 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b8ee0038-eb46-4fe2-bb3e-d6d07a1c2109 req-29de8d25-165a-43d0-ab59-c440a5ebb08b tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 210 time: 0.0313671 Nov 24 11:23:07.885110 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-71bc0857-c25d-4f8f-8e49-dd4d1e45ac29 req-2f15c2a0-c4ee-4d9e-a0a0-6016b8752681 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 210 time: 0.0262179 Nov 24 11:23:08.776737 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f4caa4ca-5398-403c-b1be-3113d0633f46 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:08.962580 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-154128c7-090c-47a0-b1b3-e60c8a95fe4e req-a5bb4da8-3860-40de-97e5-93a83116e1e1 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 210 time: 0.0260415 Nov 24 11:23:09.211214 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:10.036677 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f8281244-9107-472c-83fb-9a30c10eb958 req-dfce2f2a-aae0-4c91-9792-efade511cdbb tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 210 time: 0.0256548 Nov 24 11:23:11.128049 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e0b83225-0227-4783-9b49-99b86d05e0d0 req-3cf41a38-6a1d-484c-9914-5a6e4bbc2ace tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 210 time: 0.0259888 Nov 24 11:23:11.137016 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f73b9495-26f6-451a-8b26-9b80cc1bb7cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:12.225692 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-25fcce93-da58-4858-bafb-b33b0ec3cd7c req-f5be922d-0317-436e-bf59-549ba8ea2d9c tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 210 time: 0.0299699 Nov 24 11:23:12.499435 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:12.910284 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-ccad962f-c87a-4043-ad96-8012ec1754c5 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:12.911746 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-ccad962f-c87a-4043-ad96-8012ec1754c5 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.86 "GET /v2.0/networks?id=256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d HTTP/1.1" status: 200 len: 814 time: 0.1019971 Nov 24 11:23:12.924527 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Request body: {'port': {'device_id': 'bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876', 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d', 'admin_state_up': True, 'tenant_id': 'f3594395ceb848e1bcdcf0fa1a6f78b4'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:23:13.110408 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Made reservation on behalf of f3594395ceb848e1bcdcf0fa1a6f78b4 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:23:13.113976 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:13.243173 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Allocated IP 172.20.0.9 (256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d/4c8f23cd-59c3-43ba-a990-3dfaf32f8cf7/99fa064b-6898-411f-95e1-d3974abc2c67) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:23:13.338595 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dad54e3e-b20d-44e5-abf2-c6698fd415b3 req-f3a2742e-af28-4d1a-9221-c46490ad7587 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 210 time: 0.0306685 Nov 24 11:23:13.640043 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:13.730706 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1aa4ca45-04b4-433a-a7d5-2ccacbc825c1 req-ded0dff0-9698-4099-89c3-cae2c94c78a2 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0413465 Nov 24 11:23:13.739603 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:13.784444 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:23:13.789679 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:23:13.794413 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:23:13.821921 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Pushing event updated for resources: {'Port': ['ID=99fa064b-6898-411f-95e1-d3974abc2c67,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:13.834340 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa4ca45-04b4-433a-a7d5-2ccacbc825c1 req-d28642fa-c4a9-4a30-8871-ac0c80b55ed1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:13.836173 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1aa4ca45-04b4-433a-a7d5-2ccacbc825c1 req-d28642fa-c4a9-4a30-8871-ac0c80b55ed1 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=89e9b1abd4814b03ae8c95c5918bef03&device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 1098 time: 0.0429370 Nov 24 11:23:13.849755 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:13.850354 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:13.919843 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-9e47f320-b2a1-4a3e-a0a6-c6e2e52d2e78 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9988859 Nov 24 11:23:13.933892 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Request body: {'port': {'device_id': 'bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:23:13.941794 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa4ca45-04b4-433a-a7d5-2ccacbc825c1 req-9dc38dd3-fe41-4247-8fd5-62f4c8bf5f4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:13.943442 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1aa4ca45-04b4-433a-a7d5-2ccacbc825c1 req-9dc38dd3-fe41-4247-8fd5-62f4c8bf5f4e service neutron] 10.222.0.86 "GET /v2.0/networks?id=6b81a015-9685-4892-8d78-2a713f48dc53 HTTP/1.1" status: 200 len: 911 time: 0.0884495 Nov 24 11:23:13.991250 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:14.013358 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1aa4ca45-04b4-433a-a7d5-2ccacbc825c1 req-fe284857-613f-4cc0-84a2-e6270a6ab66a service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d HTTP/1.1" status: 200 len: 1001 time: 0.0613909 Nov 24 11:23:14.042525 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:14.065811 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa4ca45-04b4-433a-a7d5-2ccacbc825c1 req-bb075760-cacf-493c-bb32-53749bd3a23c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:14.067262 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1aa4ca45-04b4-433a-a7d5-2ccacbc825c1 req-bb075760-cacf-493c-bb32-53749bd3a23c service neutron] 10.222.0.86 "GET /v2.0/subnets?id=2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c HTTP/1.1" status: 200 len: 848 time: 0.0446980 Nov 24 11:23:14.119606 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aa4ca45-04b4-433a-a7d5-2ccacbc825c1 req-56ed9c93-8447-4326-8e4a-b634b3b0251a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:14.121091 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1aa4ca45-04b4-433a-a7d5-2ccacbc825c1 req-56ed9c93-8447-4326-8e4a-b634b3b0251a service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b81a015-9685-4892-8d78-2a713f48dc53&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0444994 Nov 24 11:23:14.213687 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1aa4ca45-04b4-433a-a7d5-2ccacbc825c1 req-f1cfc345-5eea-4b7e-b2c2-8fc65daebd71 service neutron] 10.222.0.86 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821841 Nov 24 11:23:14.259504 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 99fa064b-6898-411f-95e1-d3974abc2c67 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:23:14.266955 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:14.279515 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Transition to ACTIVE for port object 99fa064b-6898-411f-95e1-d3974abc2c67 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:23:14.304915 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1aa4ca45-04b4-433a-a7d5-2ccacbc825c1 req-5e551f72-cae1-41cd-98be-81e7c16a15f7 service neutron] 10.222.0.86 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0842021 Nov 24 11:23:14.344905 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:14.396393 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Pushing event updated for resources: {'Port': ['ID=99fa064b-6898-411f-95e1-d3974abc2c67,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:14.465739 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f7f9d3-6fcf-4866-b557-d3ff995246c6 req-f1b6611a-c1e0-429f-af9c-345c8db03202 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:14.466400 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Attempting to bind port 99fa064b-6898-411f-95e1-d3974abc2c67 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:23:14.466400 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Attempting to bind port 99fa064b-6898-411f-95e1-d3974abc2c67 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': 'd17edd0c-57ba-4458-9e65-d12987ea086d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1235, 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:23:14.466602 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Attempting to bind port 99fa064b-6898-411f-95e1-d3974abc2c67 on network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:23:14.467204 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-45f7f9d3-6fcf-4866-b557-d3ff995246c6 req-f1b6611a-c1e0-429f-af9c-345c8db03202 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 943 time: 0.0506542 Nov 24 11:23:14.470885 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Port 99fa064b-6898-411f-95e1-d3974abc2c67 on network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:23:14.471207 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Attempting to bind port 99fa064b-6898-411f-95e1-d3974abc2c67 on network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:23:14.476010 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 23, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:23:14.476343 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Checking segment: {'id': 'd17edd0c-57ba-4458-9e65-d12987ea086d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1235, 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:23:14.476725 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Bound using segment: {'id': 'd17edd0c-57ba-4458-9e65-d12987ea086d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1235, 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:23:14.477147 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Bound port: 99fa064b-6898-411f-95e1-d3974abc2c67, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd17edd0c-57ba-4458-9e65-d12987ea086d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1235, 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:23:14.477501 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:14.517880 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-45f7f9d3-6fcf-4866-b557-d3ff995246c6 req-44f6f37b-d8da-405d-8a87-ffac3f1956ea tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446591 Nov 24 11:23:14.542589 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] For port 99fa064b-6898-411f-95e1-d3974abc2c67, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:23:14.545720 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] For port 99fa064b-6898-411f-95e1-d3974abc2c67, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99fa064b-6898-411f-95e1-d3974abc2c67,segment=NetworkSegment(d17edd0c-57ba-4458-9e65-d12987ea086d),segment_id=d17edd0c-57ba-4458-9e65-d12987ea086d)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:23:14.608353 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:14.641094 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:14.641711 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:14.643230 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] 10.222.0.86 "PUT /v2.0/ports/99fa064b-6898-411f-95e1-d3974abc2c67 HTTP/1.1" status: 200 len: 1093 time: 0.7137370 Nov 24 11:23:14.645387 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876', 'tag': '99fa064b-6898-411f-95e1-d3974abc2c67'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:23:14.648337 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-796036f9-b980-4139-910e-4e33e315537a" -d '{"events": [{"name": "network-changed", "server_uuid": "bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876", "tag": "99fa064b-6898-411f-95e1-d3974abc2c67"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:23:14.675067 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcb2c8af-4651-4beb-8887-aaed749cd4db service neutron] Pushing event updated for resources: {'Port': ['ID=99fa064b-6898-411f-95e1-d3974abc2c67,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:14.687610 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:23:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-698e43e0-82f7-4023-af7d-756e6a587b1d x-openstack-request-id: req-698e43e0-82f7-4023-af7d-756e6a587b1d {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:23:14.687902 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876", "tag": "99fa064b-6898-411f-95e1-d3974abc2c67", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:23:14.688160 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-698e43e0-82f7-4023-af7d-756e6a587b1d {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:23:14.688557 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876', 'tag': '99fa064b-6898-411f-95e1-d3974abc2c67', 'status': 'completed', 'code': 200} Nov 24 11:23:14.757506 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-796036f9-b980-4139-910e-4e33e315537a req-5c6d624a-3604-4116-acdb-1797027bb30b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:14.759139 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-796036f9-b980-4139-910e-4e33e315537a req-5c6d624a-3604-4116-acdb-1797027bb30b service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=f3594395ceb848e1bcdcf0fa1a6f78b4&device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 1096 time: 0.0421593 Nov 24 11:23:14.813249 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:14.862264 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-796036f9-b980-4139-910e-4e33e315537a req-8112f58e-d021-4b92-b6b2-e7b44781f6e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:14.863769 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-796036f9-b980-4139-910e-4e33e315537a req-8112f58e-d021-4b92-b6b2-e7b44781f6e6 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=f3594395ceb848e1bcdcf0fa1a6f78b4&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0958517 Nov 24 11:23:14.959959 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-796036f9-b980-4139-910e-4e33e315537a req-734f4e0f-2ea1-4f66-9e18-79abcc317e6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:14.961691 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-796036f9-b980-4139-910e-4e33e315537a req-734f4e0f-2ea1-4f66-9e18-79abcc317e6b service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.0907302 Nov 24 11:23:15.034828 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-2fb0f692-86af-43b8-a777-b3c166d431f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:15.036381 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-2fb0f692-86af-43b8-a777-b3c166d431f2 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=f3594395ceb848e1bcdcf0fa1a6f78b4&device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 1096 time: 0.0400059 Nov 24 11:23:15.078934 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-ae15f6d1-96b8-4ff1-b4e6-a8d399825d40 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=99fa064b-6898-411f-95e1-d3974abc2c67 HTTP/1.1" status: 200 len: 217 time: 0.0340590 Nov 24 11:23:15.129607 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-350342c1-8bcd-4ca0-887d-38dbed224da8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:15.131166 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-350342c1-8bcd-4ca0-887d-38dbed224da8 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=4c8f23cd-59c3-43ba-a990-3dfaf32f8cf7 HTTP/1.1" status: 200 len: 854 time: 0.0443430 Nov 24 11:23:15.176231 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-7cd144a2-28f7-4ecb-b35b-e4cf5da6e1e4 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0294893 Nov 24 11:23:15.265783 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-ef45e4c9-159c-4592-8360-cc77bcda7729 service neutron] 10.222.0.86 "GET /v2.0/networks/256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0818069 Nov 24 11:23:15.366801 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01d9deef-4186-4bf3-bd5a-e5847048a2dc req-494394a2-2740-4c7c-8775-25dd920e1871 service neutron] 10.222.0.86 "GET /v2.0/networks/256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0867355 Nov 24 11:23:15.623546 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33706) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:15.643472 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc30da93-148a-4372-bc91-6b2d4396826e req-4ae0fae6-3f22-4680-b841-39d058a138be tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:15.644972 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dc30da93-148a-4372-bc91-6b2d4396826e req-4ae0fae6-3f22-4680-b841-39d058a138be tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 943 time: 0.0589056 Nov 24 11:23:15.692419 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dc30da93-148a-4372-bc91-6b2d4396826e req-e3daf320-a912-4448-aa71-6ad93443eebb tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408494 Nov 24 11:23:15.734928 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6d845912-c1bd-45f7-9e5c-f1d055d1dad4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:15.810447 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6d845912-c1bd-45f7-9e5c-f1d055d1dad4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:15.927667 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-6d845912-c1bd-45f7-9e5c-f1d055d1dad4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:15.966321 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d845912-c1bd-45f7-9e5c-f1d055d1dad4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aacf2cc0-d580-4cae-b93b-0bab13a11add,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:15.970604 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-6d845912-c1bd-45f7-9e5c-f1d055d1dad4 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=adeb4239793d4143a2c570669a2e454c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3461237 Nov 24 11:23:15.973294 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33710) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:16.021261 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-08108b7e-be77-45c5-bdeb-5376cd213f9d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:16.042794 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-08108b7e-be77-45c5-bdeb-5376cd213f9d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:16.156237 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-08108b7e-be77-45c5-bdeb-5376cd213f9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:16.158785 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-08108b7e-be77-45c5-bdeb-5376cd213f9d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:16.159952 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-08108b7e-be77-45c5-bdeb-5376cd213f9d admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/aacf2cc0-d580-4cae-b93b-0bab13a11add HTTP/1.1" status: 204 len: 168 time: 0.1857774 Nov 24 11:23:16.167727 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08108b7e-be77-45c5-bdeb-5376cd213f9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aacf2cc0-d580-4cae-b93b-0bab13a11add,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:16.785586 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 33718) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:16.800205 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4c690765-be0a-45b3-aa49-1e67bf62fd13 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:16.815337 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a841a379-2a54-4db4-842c-d9e3f02d37b9 req-2c2fd7a1-da04-4ec3-9292-be8f08c450b0 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:16.817463 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a841a379-2a54-4db4-842c-d9e3f02d37b9 req-2c2fd7a1-da04-4ec3-9292-be8f08c450b0 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 943 time: 0.0540695 Nov 24 11:23:16.868706 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a841a379-2a54-4db4-842c-d9e3f02d37b9 req-94728b2d-6bcd-4712-addb-88d16da28de6 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440822 Nov 24 11:23:16.877779 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4c690765-be0a-45b3-aa49-1e67bf62fd13 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:16.944561 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4c690765-be0a-45b3-aa49-1e67bf62fd13 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:16.984291 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-4c690765-be0a-45b3-aa49-1e67bf62fd13 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=3ef461f167614ca589744ad284fe5d35&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1975183 Nov 24 11:23:16.985061 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c690765-be0a-45b3-aa49-1e67bf62fd13 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f0c0d2d-02f5-400d-80ce-c06c2891f1ec,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:16.986860 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33720) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:17.039422 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ba4871a4-0b22-489f-9cec-0b4af9a20f1e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:17.060279 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ba4871a4-0b22-489f-9cec-0b4af9a20f1e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:17.190312 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ba4871a4-0b22-489f-9cec-0b4af9a20f1e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:17.192916 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-ba4871a4-0b22-489f-9cec-0b4af9a20f1e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:17.194042 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-ba4871a4-0b22-489f-9cec-0b4af9a20f1e admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/2f0c0d2d-02f5-400d-80ce-c06c2891f1ec HTTP/1.1" status: 204 len: 168 time: 0.2060084 Nov 24 11:23:17.202362 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba4871a4-0b22-489f-9cec-0b4af9a20f1e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f0c0d2d-02f5-400d-80ce-c06c2891f1ec,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:17.473546 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99fa064b-6898-411f-95e1-d3974abc2c67 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:23:17.570476 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99fa064b-6898-411f-95e1-d3974abc2c67, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99fa064b-6898-411f-95e1-d3974abc2c67,segment=NetworkSegment(d17edd0c-57ba-4458-9e65-d12987ea086d),segment_id=d17edd0c-57ba-4458-9e65-d12987ea086d)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:23:17.582105 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '99fa064b-6898-411f-95e1-d3974abc2c67', 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d', 'port_id': '99fa064b-6898-411f-95e1-d3974abc2c67', 'mac_address': 'fa:16:3e:9d:bc:c8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1235, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4c8f23cd-59c3-43ba-a990-3dfaf32f8cf7', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:23:17.620215 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:17.638787 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 99fa064b-6898-411f-95e1-d3974abc2c67 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:23:17.657279 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99fa064b-6898-411f-95e1-d3974abc2c67, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99fa064b-6898-411f-95e1-d3974abc2c67,segment=NetworkSegment(d17edd0c-57ba-4458-9e65-d12987ea086d),segment_id=d17edd0c-57ba-4458-9e65-d12987ea086d)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:23:17.746045 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:17.793941 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=99fa064b-6898-411f-95e1-d3974abc2c67,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:17.963271 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['99fa064b-6898-411f-95e1-d3974abc2c67'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:23:17.996384 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64124ad1-9853-4343-902e-ad3c783cd362 req-0dbeb94a-3747-4f19-a82e-06fad69868a6 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:17.997983 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-64124ad1-9853-4343-902e-ad3c783cd362 req-0dbeb94a-3747-4f19-a82e-06fad69868a6 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 944 time: 0.0593319 Nov 24 11:23:18.052747 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-64124ad1-9853-4343-902e-ad3c783cd362 req-8cdf8faf-4f0e-43c0-802a-86a581942830 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452478 Nov 24 11:23:18.211731 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33744) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:18.306842 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1029814046-network', 'tenant_id': 'ce63b1fb0d1643aab7992a7bf0f6e4a9'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:23:18.379206 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Made reservation on behalf of ce63b1fb0d1643aab7992a7bf0f6e4a9 for: {'network': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:23:18.381529 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:18.390343 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:18.462260 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:18.545089 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:18.569324 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1242} {{(pid=103244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:23:18.578622 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9241136b-0f85-441b-aeec-488be63e1c99,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:18.585002 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:18.585591 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.segments_db [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Added segment d0a2f257-fdfd-4061-9fdf-7fdba02b7243 of type vlan for network 8609cd71-c5f5-4b55-b2b9-7da5e3316a83 Nov 24 11:23:18.624345 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:18.707912 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:18.708841 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:18.709412 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:18.768558 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] Pushing event updated for resources: {'Network': ['ID=8609cd71-c5f5-4b55-b2b9-7da5e3316a83,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:18.779594 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 8609cd71-c5f5-4b55-b2b9-7da5e3316a83 details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:23:18.825636 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-aea026c1-ef6a-443e-b50f-d023649f7986 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.6126301 Nov 24 11:23:18.828460 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33748) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:18.833065 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-12b01499-816c-43da-bff0-af5f9676130e admin admin] Request body: {'subnet': {'network_id': '8609cd71-c5f5-4b55-b2b9-7da5e3316a83', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1029814046-subnet', 'tenant_id': 'ce63b1fb0d1643aab7992a7bf0f6e4a9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:23:18.919075 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-12b01499-816c-43da-bff0-af5f9676130e admin admin] Made reservation on behalf of ce63b1fb0d1643aab7992a7bf0f6e4a9 for: {'subnet': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:23:18.921387 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-12b01499-816c-43da-bff0-af5f9676130e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8480549'] for subnet, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:19.153894 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-12b01499-816c-43da-bff0-af5f9676130e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8698972', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8480535'] for subnet, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:19.219316 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-469dc6c8-3e7a-48a3-a45c-86740db0d574 req-3e520d9f-2553-491b-b127-74a58c889170 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:19.220788 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-469dc6c8-3e7a-48a3-a45c-86740db0d574 req-3e520d9f-2553-491b-b127-74a58c889170 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 944 time: 0.0955377 Nov 24 11:23:19.224053 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12b01499-816c-43da-bff0-af5f9676130e admin admin] Pushing event updated for resources: {'Subnet': ['ID=0677d253-e516-4c2d-b0b8-fd71ef174d72,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:19.260539 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12b01499-816c-43da-bff0-af5f9676130e admin admin] Checking segment: {'id': 'd0a2f257-fdfd-4061-9fdf-7fdba02b7243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1242, 'network_id': '8609cd71-c5f5-4b55-b2b9-7da5e3316a83'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:23:19.261024 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12b01499-816c-43da-bff0-af5f9676130e admin admin] Network hostable DHCP agents. Network: 8609cd71-c5f5-4b55-b2b9-7da5e3316a83, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:23:19.290474 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-469dc6c8-3e7a-48a3-a45c-86740db0d574 req-39bafc5d-b91d-48a7-bf91-cd15faacf2fe tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0627787 Nov 24 11:23:19.348029 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12b01499-816c-43da-bff0-af5f9676130e admin admin] Network 8609cd71-c5f5-4b55-b2b9-7da5e3316a83 is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:23:19.422312 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-12b01499-816c-43da-bff0-af5f9676130e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 8609cd71-c5f5-4b55-b2b9-7da5e3316a83) {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:23:19.426414 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-12b01499-816c-43da-bff0-af5f9676130e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:19.427005 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-12b01499-816c-43da-bff0-af5f9676130e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:19.432857 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be1ef3f8-f3b8-4f35-89c7-8f9d28764eaa None None] Network 8609cd71-c5f5-4b55-b2b9-7da5e3316a83 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:23:19.493375 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99fa064b-6898-411f-95e1-d3974abc2c67 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:23:19.511079 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-12b01499-816c-43da-bff0-af5f9676130e admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6815159 Nov 24 11:23:19.587651 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-941e7486-f410-4aa4-b23a-f0286e3a8811 None None] Network 8609cd71-c5f5-4b55-b2b9-7da5e3316a83 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:23:19.648062 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 99fa064b-6898-411f-95e1-d3974abc2c67 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:23:19.656134 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 99fa064b-6898-411f-95e1-d3974abc2c67 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:23:19.656499 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:19.787911 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:19.811445 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99fa064b-6898-411f-95e1-d3974abc2c67'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:23:19.813686 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c96f3f3f-330b-4cda-9726-ea028ccc084f" -d '{"events": [{"server_uuid": "bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876", "name": "network-vif-plugged", "status": "completed", "tag": "99fa064b-6898-411f-95e1-d3974abc2c67"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:23:19.825870 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 99fa064b-6898-411f-95e1-d3974abc2c67, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99fa064b-6898-411f-95e1-d3974abc2c67,segment=NetworkSegment(d17edd0c-57ba-4458-9e65-d12987ea086d),segment_id=d17edd0c-57ba-4458-9e65-d12987ea086d)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:23:19.852249 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:23:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8e9a550d-256d-42df-864a-8380b7ce3168 x-openstack-request-id: req-8e9a550d-256d-42df-864a-8380b7ce3168 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:23:19.852543 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876", "name": "network-vif-plugged", "status": "completed", "tag": "99fa064b-6898-411f-95e1-d3974abc2c67", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:23:19.852800 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-8e9a550d-256d-42df-864a-8380b7ce3168 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:23:19.853186 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99fa064b-6898-411f-95e1-d3974abc2c67', 'code': 200} Nov 24 11:23:19.928384 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:19.981661 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=99fa064b-6898-411f-95e1-d3974abc2c67,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:20.201555 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33768) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:20.206362 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1317377690-network', 'tenant_id': '8e927ed3067a4f008ff84006c6f37d07'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:23:20.286521 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7de9c43-1a73-4c15-8f4a-af3c78dc4083 req-2c13605d-79ae-4088-88cf-086e994f437c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:20.288307 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-f7de9c43-1a73-4c15-8f4a-af3c78dc4083 req-2c13605d-79ae-4088-88cf-086e994f437c service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 1098 time: 0.0401843 Nov 24 11:23:20.337425 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-f7de9c43-1a73-4c15-8f4a-af3c78dc4083 req-55c0fc08-ca8b-417b-9cad-813304980b55 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418348 Nov 24 11:23:20.339355 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Made reservation on behalf of 8e927ed3067a4f008ff84006c6f37d07 for: {'network': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:23:20.341819 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:20.350955 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:20.430233 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3e6dfd-1276-44e5-9246-7b9e796278ed req-3a646ef6-0443-4b27-b2bd-7f0a27ca9d0f tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:20.431642 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3e3e6dfd-1276-44e5-9246-7b9e796278ed req-3a646ef6-0443-4b27-b2bd-7f0a27ca9d0f tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 945 time: 0.0704305 Nov 24 11:23:20.495420 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:20.503262 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3e3e6dfd-1276-44e5-9246-7b9e796278ed req-248f5f43-3ffd-477f-b962-a7e72c0e2f24 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644748 Nov 24 11:23:20.559825 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:20.584282 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1246} {{(pid=103244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:23:20.594618 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a0e1870c-d886-40cb-81ee-a66df0c3c4b6,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:20.599152 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:20.599503 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.segments_db [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Added segment 303c2fc2-e9d9-48da-a4f2-b8b089ca4b3f of type vlan for network e40c66c6-230f-4f6e-8d94-725b4480259d Nov 24 11:23:20.638285 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:20.733494 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:20.734610 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:20.735184 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:20.800945 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] Pushing event updated for resources: {'Network': ['ID=e40c66c6-230f-4f6e-8d94-725b4480259d,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:20.811223 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network e40c66c6-230f-4f6e-8d94-725b4480259d details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:23:20.833424 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-41eb52ec-8e51-416a-8b20-9e05a4180b4d admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.6282392 Nov 24 11:23:20.833620 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 33774) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:20.838684 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-b08416db-f7cd-4817-85c7-8dbb0cadab76 admin admin] Request body: {'subnet': {'network_id': 'e40c66c6-230f-4f6e-8d94-725b4480259d', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1317377690-subnet', 'tenant_id': '8e927ed3067a4f008ff84006c6f37d07', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:23:20.916363 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b08416db-f7cd-4817-85c7-8dbb0cadab76 admin admin] Made reservation on behalf of 8e927ed3067a4f008ff84006c6f37d07 for: {'subnet': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:23:20.919230 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b08416db-f7cd-4817-85c7-8dbb0cadab76 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8480549'] for subnet, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:21.142550 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b08416db-f7cd-4817-85c7-8dbb0cadab76 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8698972', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8480535'] for subnet, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:21.454116 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08416db-f7cd-4817-85c7-8dbb0cadab76 admin admin] Pushing event updated for resources: {'Subnet': ['ID=34aecdbf-89d2-475a-abf0-adb675680d87,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:21.459134 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b08416db-f7cd-4817-85c7-8dbb0cadab76 admin admin] Checking segment: {'id': '303c2fc2-e9d9-48da-a4f2-b8b089ca4b3f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1246, 'network_id': 'e40c66c6-230f-4f6e-8d94-725b4480259d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:23:21.459578 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b08416db-f7cd-4817-85c7-8dbb0cadab76 admin admin] Network hostable DHCP agents. Network: e40c66c6-230f-4f6e-8d94-725b4480259d, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:23:21.542237 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b08416db-f7cd-4817-85c7-8dbb0cadab76 admin admin] Network e40c66c6-230f-4f6e-8d94-725b4480259d is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:23:21.613223 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-b08416db-f7cd-4817-85c7-8dbb0cadab76 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, e40c66c6-230f-4f6e-8d94-725b4480259d) {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:23:21.621829 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b08416db-f7cd-4817-85c7-8dbb0cadab76 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:21.621829 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b08416db-f7cd-4817-85c7-8dbb0cadab76 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:21.622897 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e8761fff-3fd8-4cd6-991e-5cf2976112ec None None] Network e40c66c6-230f-4f6e-8d94-725b4480259d requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:23:21.629797 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b11080c7-47f7-409b-9e00-2c16da7e4780 req-ccec3537-5434-42fd-b5c6-faa9df3c6132 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:21.631274 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b11080c7-47f7-409b-9e00-2c16da7e4780 req-ccec3537-5434-42fd-b5c6-faa9df3c6132 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 945 time: 0.0554373 Nov 24 11:23:21.681297 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b11080c7-47f7-409b-9e00-2c16da7e4780 req-68b50f88-3f43-4ed2-b2f7-bafe68a0b47e tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428045 Nov 24 11:23:21.704900 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-b08416db-f7cd-4817-85c7-8dbb0cadab76 admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.8702583 Nov 24 11:23:21.757527 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71a1f0f7-eeff-4b33-a9ea-1e3571bc7974 None None] Network e40c66c6-230f-4f6e-8d94-725b4480259d requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:23:22.800586 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5ce163d-a388-495d-bb67-8202cb48be20 req-13fb7fd5-648c-470d-8d9c-8fbf8acf7148 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:22.802070 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d5ce163d-a388-495d-bb67-8202cb48be20 req-13fb7fd5-648c-470d-8d9c-8fbf8acf7148 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 945 time: 0.0500796 Nov 24 11:23:22.852342 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d5ce163d-a388-495d-bb67-8202cb48be20 req-61ecc220-b344-4815-ae54-a825462cb13a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442338 Nov 24 11:23:36.070038 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:23:38.177061 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 33996) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:38.221455 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_v2 [None req-c1d062d5-c1aa-4520-93c2-ad73fe4b4ea5 admin admin] Deleting subnet 0677d253-e516-4c2d-b0b8-fd71ef174d72 {{(pid=103243) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:23:38.224616 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1d062d5-c1aa-4520-93c2-ad73fe4b4ea5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.258847 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1d062d5-c1aa-4520-93c2-ad73fe4b4ea5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-9292937'] for subnet, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.296692 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1d062d5-c1aa-4520-93c2-ad73fe4b4ea5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.405510 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1d062d5-c1aa-4520-93c2-ad73fe4b4ea5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8721838', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9106635'] for subnet, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.432733 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1d062d5-c1aa-4520-93c2-ad73fe4b4ea5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0677d253-e516-4c2d-b0b8-fd71ef174d72,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:38.438908 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c1d062d5-c1aa-4520-93c2-ad73fe4b4ea5 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.442958 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-c1d062d5-c1aa-4520-93c2-ad73fe4b4ea5 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/0677d253-e516-4c2d-b0b8-fd71ef174d72 HTTP/1.1" status: 204 len: 168 time: 0.2649088 Nov 24 11:23:38.445556 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 34000) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:38.511466 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.589527 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.608538 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8609cd71-c5f5-4b55-b2b9-7da5e3316a83']}} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:23:38.618030 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd0a2f257-fdfd-4061-9fdf-7fdba02b7243') {'for_net_delete': True} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:23:38.618345 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd0a2f257-fdfd-4061-9fdf-7fdba02b7243') {} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:23:38.627397 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-9292944'] for segment, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.640774 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.646510 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] Releasing vlan 1242 on physical network physnet1 to pool {{(pid=103243) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:23:38.646889 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8721920'] for segment, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: Traceback (most recent call last): Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: timer() Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: cb(*args, **kw) Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: return func(*args, **kwargs) Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: self._notify() Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: self.callback(batched_events) Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: event.method(event) Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: return f(self, *a, **k) Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._get(url).json() Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: return self.request(url, 'GET', **kwargs) Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:23:38.648531 dv-cinder-804035-18-iscsi neutron-server[103243]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:23:38.744691 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-474ee237-b70a-4097-95d6-2d97a231492e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.756396 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.760570 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.764126 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] 10.222.0.76 "DELETE /v2.0/networks/8609cd71-c5f5-4b55-b2b9-7da5e3316a83 HTTP/1.1" status: 204 len: 168 time: 0.3176470 Nov 24 11:23:38.766858 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34002) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:38.777147 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86e1fef0-d4e4-4518-b521-6f30b0df9a7c admin admin] Pushing event deleted for resources: {'Network': ['ID=8609cd71-c5f5-4b55-b2b9-7da5e3316a83,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:38.810837 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_v2 [None req-10fe927c-8a1b-4277-9793-673524736fcf admin admin] Deleting subnet 34aecdbf-89d2-475a-abf0-adb675680d87 {{(pid=103244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:23:38.814007 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-10fe927c-8a1b-4277-9793-673524736fcf admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.850396 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-10fe927c-8a1b-4277-9793-673524736fcf admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4161249'] for subnet, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:38.890086 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-10fe927c-8a1b-4277-9793-673524736fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.014119 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-10fe927c-8a1b-4277-9793-673524736fcf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8699037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8480512'] for subnet, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.040623 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10fe927c-8a1b-4277-9793-673524736fcf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=34aecdbf-89d2-475a-abf0-adb675680d87,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:39.042568 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-10fe927c-8a1b-4277-9793-673524736fcf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.045756 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-10fe927c-8a1b-4277-9793-673524736fcf admin admin] 10.222.0.76 "DELETE /v2.0/subnets/34aecdbf-89d2-475a-abf0-adb675680d87 HTTP/1.1" status: 204 len: 168 time: 0.2778738 Nov 24 11:23:39.048204 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34004) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:39.119708 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.199621 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.212957 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.220045 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e40c66c6-230f-4f6e-8d94-725b4480259d']}} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:23:39.229550 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '303c2fc2-e9d9-48da-a4f2-b8b089ca4b3f') {'for_net_delete': True} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:23:39.229839 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '303c2fc2-e9d9-48da-a4f2-b8b089ca4b3f') {} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:23:39.239407 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4161272'] for segment, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.252088 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.258414 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] Releasing vlan 1246 on physical network physnet1 to pool {{(pid=103244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:23:39.258788 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8699699'] for segment, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: Traceback (most recent call last): Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: timer() Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: cb(*args, **kw) Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: return func(*args, **kwargs) Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: self._notify() Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: self.callback(batched_events) Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: event.method(event) Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: return f(self, *a, **k) Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._get(url).json() Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: return self.request(url, 'GET', **kwargs) Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:23:39.260450 dv-cinder-804035-18-iscsi neutron-server[103244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:23:39.367269 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.372414 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.375525 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] 10.222.0.76 "DELETE /v2.0/networks/e40c66c6-230f-4f6e-8d94-725b4480259d HTTP/1.1" status: 204 len: 168 time: 0.3263588 Nov 24 11:23:39.386836 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa419a96-e2eb-400c-ad1f-c51f8e05993e admin admin] Pushing event deleted for resources: {'Network': ['ID=e40c66c6-230f-4f6e-8d94-725b4480259d,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:39.730733 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34010) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:39.771345 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-2cc59afb-62d4-40d5-b691-70479163d773 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=ce63b1fb0d1643aab7992a7bf0f6e4a9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0381417 Nov 24 11:23:39.773859 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34012) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:39.819897 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-45b548d1-0a8b-41f0-8ce7-e9d0b3c8eabd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.840895 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-45b548d1-0a8b-41f0-8ce7-e9d0b3c8eabd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.956033 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-45b548d1-0a8b-41f0-8ce7-e9d0b3c8eabd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.958743 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-45b548d1-0a8b-41f0-8ce7-e9d0b3c8eabd admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:39.959909 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-45b548d1-0a8b-41f0-8ce7-e9d0b3c8eabd admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/9241136b-0f85-441b-aeec-488be63e1c99 HTTP/1.1" status: 204 len: 168 time: 0.1851625 Nov 24 11:23:39.967918 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b548d1-0a8b-41f0-8ce7-e9d0b3c8eabd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9241136b-0f85-441b-aeec-488be63e1c99,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:40.545852 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34020) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:40.585515 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-d4c09e4a-5c83-468d-b189-eec97d9ef9bd admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=8e927ed3067a4f008ff84006c6f37d07&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0384955 Nov 24 11:23:40.588245 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34022) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:40.636883 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b54f0cda-4424-4122-928c-078ae80d68da admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:40.656742 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b54f0cda-4424-4122-928c-078ae80d68da admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:40.804802 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b54f0cda-4424-4122-928c-078ae80d68da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:40.807373 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-b54f0cda-4424-4122-928c-078ae80d68da admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:40.808509 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-b54f0cda-4424-4122-928c-078ae80d68da admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/a0e1870c-d886-40cb-81ee-a66df0c3c4b6 HTTP/1.1" status: 204 len: 168 time: 0.2194085 Nov 24 11:23:40.816018 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b54f0cda-4424-4122-928c-078ae80d68da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0e1870c-d886-40cb-81ee-a66df0c3c4b6,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:41.155946 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-3d513fc3-d846-4aa5-87ad-68cd8f7f1c4c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:41.745646 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 34046) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:41.839722 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-279896561-network', 'tenant_id': '603b0bf1aabf49efb7ac8be965b64567'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:23:41.936340 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Made reservation on behalf of 603b0bf1aabf49efb7ac8be965b64567 for: {'network': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:23:41.938649 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:41.951610 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:42.024330 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:42.079041 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:42.105744 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1217} {{(pid=103243) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:23:42.110874 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=72521c9f-0ea2-40e1-9b1f-577c15c394f6,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:42.118090 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:42.118364 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.segments_db [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Added segment 698e6ff0-3fe3-4914-b785-972d8f6cc124 of type vlan for network c3773775-201b-4142-b6ec-b6fb9be9b452 Nov 24 11:23:42.157872 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:42.244799 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:42.245748 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:42.246325 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:42.307844 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] Pushing event updated for resources: {'Network': ['ID=c3773775-201b-4142-b6ec-b6fb9be9b452,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:42.316069 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-49c31e31-8f7e-4a16-a71e-0d545fb93748 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5693920 Nov 24 11:23:42.317535 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network c3773775-201b-4142-b6ec-b6fb9be9b452 details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:23:42.318931 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 34050) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:23:42.323747 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-89ea4314-e356-47d6-96a9-a6e148b557a1 admin admin] Request body: {'subnet': {'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-279896561-subnet', 'tenant_id': '603b0bf1aabf49efb7ac8be965b64567', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:23:42.399352 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-89ea4314-e356-47d6-96a9-a6e148b557a1 admin admin] Made reservation on behalf of 603b0bf1aabf49efb7ac8be965b64567 for: {'subnet': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:23:42.401699 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-89ea4314-e356-47d6-96a9-a6e148b557a1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9106670'] for subnet, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:42.555318 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:42.647789 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-89ea4314-e356-47d6-96a9-a6e148b557a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8721775', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9106652'] for subnet, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:42.704267 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89ea4314-e356-47d6-96a9-a6e148b557a1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=458596b0-9c4c-4b58-86f1-e732479ac853,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:42.711951 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-89ea4314-e356-47d6-96a9-a6e148b557a1 admin admin] Checking segment: {'id': '698e6ff0-3fe3-4914-b785-972d8f6cc124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1217, 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:23:42.712299 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89ea4314-e356-47d6-96a9-a6e148b557a1 admin admin] Network hostable DHCP agents. Network: c3773775-201b-4142-b6ec-b6fb9be9b452, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103243) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:23:42.776688 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-89ea4314-e356-47d6-96a9-a6e148b557a1 admin admin] Network c3773775-201b-4142-b6ec-b6fb9be9b452 is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103243) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:23:42.847429 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-89ea4314-e356-47d6-96a9-a6e148b557a1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, c3773775-201b-4142-b6ec-b6fb9be9b452) {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:23:42.851820 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-89ea4314-e356-47d6-96a9-a6e148b557a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:42.852439 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-89ea4314-e356-47d6-96a9-a6e148b557a1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:42.856455 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-23b758e3-fa28-4c5f-9d5c-b4d258b42798 None None] Network c3773775-201b-4142-b6ec-b6fb9be9b452 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:23:42.939508 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-89ea4314-e356-47d6-96a9-a6e148b557a1 admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6193750 Nov 24 11:23:42.980967 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cdd3ac9d-df06-480f-bfa4-2666d20fb4d6 None None] Network c3773775-201b-4142-b6ec-b6fb9be9b452 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:23:44.085227 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:44.830386 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:45.062114 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-2fc1034c-90ba-4e46-a8d7-0c175891b8b0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:45.063515 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-2fc1034c-90ba-4e46-a8d7-0c175891b8b0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/networks?id=c3773775-201b-4142-b6ec-b6fb9be9b452 HTTP/1.1" status: 200 len: 808 time: 0.0989215 Nov 24 11:23:45.078057 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-425b3886-7b03-4ae0-af0d-3b418bcc8fd1 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/quotas/603b0bf1aabf49efb7ac8be965b64567 HTTP/1.1" status: 200 len: 375 time: 0.0088480 Nov 24 11:23:45.112738 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-be9cc375-98ca-4fa9-874e-b3312bd59b8f tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=603b0bf1aabf49efb7ac8be965b64567&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0291338 Nov 24 11:23:45.248504 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-d85119e6-cf67-486b-914e-3a587779925a service neutron] 10.222.0.76 "GET /v2.0/networks/c3773775-201b-4142-b6ec-b6fb9be9b452?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1282318 Nov 24 11:23:45.340442 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-435f6f57-a901-46a1-a2eb-d6de76ece885 service neutron] 10.222.0.76 "GET /v2.0/networks/c3773775-201b-4142-b6ec-b6fb9be9b452?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859954 Nov 24 11:23:45.594904 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-35d75b9b-254d-4fc2-9830-7a2424278777 req-2d1bb0d6-dc3f-42de-ae3c-ad6f21cf9bc9 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 210 time: 0.0277364 Nov 24 11:23:46.689723 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e0584f84-5500-4add-a437-fd7d46e412f3 req-b08f0837-2b05-4a54-99d4-188bf3e3bff6 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 210 time: 0.0270782 Nov 24 11:23:47.786451 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f15ee3b5-1893-417b-8552-6d6ecb457fad req-0feea061-a81a-41cf-94f7-8c17a4b65adc tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 210 time: 0.0284214 Nov 24 11:23:47.941200 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b4a42c95-b185-4ef0-992b-73a83ebf3f38 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:47.943174 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b4a42c95-b185-4ef0-992b-73a83ebf3f38 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.86 "GET /v2.0/networks?id=c3773775-201b-4142-b6ec-b6fb9be9b452 HTTP/1.1" status: 200 len: 808 time: 0.1028364 Nov 24 11:23:47.959069 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Request body: {'port': {'device_id': '76a1192b-e3f1-48b1-a56a-2b22a5f759b6', 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452', 'admin_state_up': True, 'tenant_id': '603b0bf1aabf49efb7ac8be965b64567'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:23:48.133474 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Made reservation on behalf of 603b0bf1aabf49efb7ac8be965b64567 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:23:48.137168 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:48.267025 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Allocated IP 172.20.0.10 (c3773775-201b-4142-b6ec-b6fb9be9b452/458596b0-9c4c-4b58-86f1-e732479ac853/1eabfe33-b922-40ca-a921-b06d3e600523) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:23:48.413529 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:48.513612 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:48.554745 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Network c3773775-201b-4142-b6ec-b6fb9be9b452 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:23:48.559668 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:23:48.563131 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:23:48.589111 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Pushing event updated for resources: {'Port': ['ID=1eabfe33-b922-40ca-a921-b06d3e600523,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:48.615255 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:48.615890 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:48.675820 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b1e96376-e84b-41ec-9c9d-962f97a2bbc3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7210038 Nov 24 11:23:48.688492 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Request body: {'port': {'device_id': '76a1192b-e3f1-48b1-a56a-2b22a5f759b6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:23:48.743464 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:48.903652 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-663ba9d0-e3c5-4829-902e-9c097faca97f req-5328bc9d-69d8-4f91-be76-c991147570cc tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:48.905107 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-663ba9d0-e3c5-4829-902e-9c097faca97f req-5328bc9d-69d8-4f91-be76-c991147570cc tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 932 time: 0.0515797 Nov 24 11:23:48.953147 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-663ba9d0-e3c5-4829-902e-9c097faca97f req-debe0a3a-a4df-434a-a6e6-b3f64e026785 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412164 Nov 24 11:23:49.013568 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1eabfe33-b922-40ca-a921-b06d3e600523 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:23:49.023744 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:49.037170 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Transition to ACTIVE for port object 1eabfe33-b922-40ca-a921-b06d3e600523 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:23:49.127542 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:49.177726 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Pushing event updated for resources: {'Port': ['ID=1eabfe33-b922-40ca-a921-b06d3e600523,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:49.245500 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Attempting to bind port 1eabfe33-b922-40ca-a921-b06d3e600523 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:23:49.245743 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Attempting to bind port 1eabfe33-b922-40ca-a921-b06d3e600523 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '698e6ff0-3fe3-4914-b785-972d8f6cc124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1217, 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:23:49.246059 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Attempting to bind port 1eabfe33-b922-40ca-a921-b06d3e600523 on network c3773775-201b-4142-b6ec-b6fb9be9b452 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:23:49.250204 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Port 1eabfe33-b922-40ca-a921-b06d3e600523 on network c3773775-201b-4142-b6ec-b6fb9be9b452 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:23:49.250514 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Attempting to bind port 1eabfe33-b922-40ca-a921-b06d3e600523 on network c3773775-201b-4142-b6ec-b6fb9be9b452 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:23:49.255156 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 23, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:23:49.255507 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Checking segment: {'id': '698e6ff0-3fe3-4914-b785-972d8f6cc124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1217, 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:23:49.255879 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Bound using segment: {'id': '698e6ff0-3fe3-4914-b785-972d8f6cc124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1217, 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:23:49.256451 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Bound port: 1eabfe33-b922-40ca-a921-b06d3e600523, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '698e6ff0-3fe3-4914-b785-972d8f6cc124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1217, 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:23:49.256790 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:49.318884 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] For port 1eabfe33-b922-40ca-a921-b06d3e600523, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:23:49.321812 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] For port 1eabfe33-b922-40ca-a921-b06d3e600523, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=1eabfe33-b922-40ca-a921-b06d3e600523,segment=NetworkSegment(698e6ff0-3fe3-4914-b785-972d8f6cc124),segment_id=698e6ff0-3fe3-4914-b785-972d8f6cc124)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:23:49.402335 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:49.437193 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:49.437806 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:49.439181 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] 10.222.0.86 "PUT /v2.0/ports/1eabfe33-b922-40ca-a921-b06d3e600523 HTTP/1.1" status: 200 len: 1094 time: 0.7547300 Nov 24 11:23:49.439668 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '76a1192b-e3f1-48b1-a56a-2b22a5f759b6', 'tag': '1eabfe33-b922-40ca-a921-b06d3e600523'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:23:49.443281 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9b3d2cce-1120-4d16-b94c-df7c2b9487e5" -d '{"events": [{"name": "network-changed", "server_uuid": "76a1192b-e3f1-48b1-a56a-2b22a5f759b6", "tag": "1eabfe33-b922-40ca-a921-b06d3e600523"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:23:49.466877 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7900f445-5d38-4581-9e59-d490a1d522c4 service neutron] Pushing event updated for resources: {'Port': ['ID=1eabfe33-b922-40ca-a921-b06d3e600523,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:49.479733 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:23:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-23778e4d-c1a2-4aeb-bb80-77bc0bd31104 x-openstack-request-id: req-23778e4d-c1a2-4aeb-bb80-77bc0bd31104 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:23:49.480024 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "76a1192b-e3f1-48b1-a56a-2b22a5f759b6", "tag": "1eabfe33-b922-40ca-a921-b06d3e600523", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:23:49.480274 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-23778e4d-c1a2-4aeb-bb80-77bc0bd31104 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:23:49.480672 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '76a1192b-e3f1-48b1-a56a-2b22a5f759b6', 'tag': '1eabfe33-b922-40ca-a921-b06d3e600523', 'status': 'completed', 'code': 200} Nov 24 11:23:49.548196 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b3d2cce-1120-4d16-b94c-df7c2b9487e5 req-37285908-a2c0-436b-b10b-8a7e2c232df3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:49.549577 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9b3d2cce-1120-4d16-b94c-df7c2b9487e5 req-37285908-a2c0-436b-b10b-8a7e2c232df3 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=603b0bf1aabf49efb7ac8be965b64567&device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 1097 time: 0.0445356 Nov 24 11:23:49.650447 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b3d2cce-1120-4d16-b94c-df7c2b9487e5 req-caad1f8c-cc3a-4ea4-bc82-25c5cd89bdbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:49.651928 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9b3d2cce-1120-4d16-b94c-df7c2b9487e5 req-caad1f8c-cc3a-4ea4-bc82-25c5cd89bdbc service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=603b0bf1aabf49efb7ac8be965b64567&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0944908 Nov 24 11:23:49.747524 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b3d2cce-1120-4d16-b94c-df7c2b9487e5 req-9caf2f87-50a1-4087-881e-a276e8bda0ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:49.748996 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9b3d2cce-1120-4d16-b94c-df7c2b9487e5 req-9caf2f87-50a1-4087-881e-a276e8bda0ef service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.0887697 Nov 24 11:23:49.829235 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-ce1c7261-6a86-4538-ae7d-24d9fa0a4d6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:49.829454 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-ce1c7261-6a86-4538-ae7d-24d9fa0a4d6f service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=603b0bf1aabf49efb7ac8be965b64567&device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 1097 time: 0.0413156 Nov 24 11:23:49.873306 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-44d288aa-70da-4991-948e-e519f0f43773 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=1eabfe33-b922-40ca-a921-b06d3e600523 HTTP/1.1" status: 200 len: 217 time: 0.0356562 Nov 24 11:23:49.922202 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-039b6970-ed0f-406a-994f-fa3f2aadf4c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:49.923752 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-039b6970-ed0f-406a-994f-fa3f2aadf4c9 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=458596b0-9c4c-4b58-86f1-e732479ac853 HTTP/1.1" status: 200 len: 848 time: 0.0431232 Nov 24 11:23:49.955430 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-b86ccc42-1c80-40cc-81e8-58723c3b09bb service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=c3773775-201b-4142-b6ec-b6fb9be9b452&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0247073 Nov 24 11:23:50.049326 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-94a01951-599d-4431-81ae-e1d47df916cb service neutron] 10.222.0.86 "GET /v2.0/networks/c3773775-201b-4142-b6ec-b6fb9be9b452?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864615 Nov 24 11:23:50.073042 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b7b619-95d7-442f-b3df-bead2f805f18 req-02f3ffde-b84b-49fc-a9c9-0d0041355b76 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:50.074768 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-42b7b619-95d7-442f-b3df-bead2f805f18 req-02f3ffde-b84b-49fc-a9c9-0d0041355b76 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 944 time: 0.0507636 Nov 24 11:23:50.124019 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-42b7b619-95d7-442f-b3df-bead2f805f18 req-5d21ea47-cdfa-4597-b632-e9bf4df25c52 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431674 Nov 24 11:23:50.138049 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-50c39137-baf8-49d2-a192-4ef6385b8418 req-c94687c1-58e0-426c-bcb8-e079641a278b service neutron] 10.222.0.86 "GET /v2.0/networks/c3773775-201b-4142-b6ec-b6fb9be9b452?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811715 Nov 24 11:23:51.241946 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ce6a915-5593-403a-a8bc-9f0201ae5baf req-578f58f0-4037-46ef-b2ff-7c70b7b38384 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:51.248454 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ce6a915-5593-403a-a8bc-9f0201ae5baf req-578f58f0-4037-46ef-b2ff-7c70b7b38384 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 944 time: 0.0497775 Nov 24 11:23:51.297074 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ce6a915-5593-403a-a8bc-9f0201ae5baf req-605f6666-3575-4157-a524-c930ffc615af tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476167 Nov 24 11:23:52.413813 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cf6263e-7369-461d-b300-1273df30c7fe req-b8ebcb5d-be21-4609-9c95-82a9b256ed78 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:52.415280 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3cf6263e-7369-461d-b300-1273df30c7fe req-b8ebcb5d-be21-4609-9c95-82a9b256ed78 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 944 time: 0.0483866 Nov 24 11:23:52.462118 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3cf6263e-7369-461d-b300-1273df30c7fe req-c9409d35-aaa1-41e9-8c1a-627a97b5b125 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410717 Nov 24 11:23:52.565826 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 1eabfe33-b922-40ca-a921-b06d3e600523 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:23:52.662286 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 1eabfe33-b922-40ca-a921-b06d3e600523, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=1eabfe33-b922-40ca-a921-b06d3e600523,segment=NetworkSegment(698e6ff0-3fe3-4914-b785-972d8f6cc124),segment_id=698e6ff0-3fe3-4914-b785-972d8f6cc124)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:23:52.672748 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '1eabfe33-b922-40ca-a921-b06d3e600523', 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452', 'port_id': '1eabfe33-b922-40ca-a921-b06d3e600523', 'mac_address': 'fa:16:3e:15:d9:2d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1217, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '458596b0-9c4c-4b58-86f1-e732479ac853', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:23:52.709748 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:52.721974 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1eabfe33-b922-40ca-a921-b06d3e600523 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:23:52.741290 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 1eabfe33-b922-40ca-a921-b06d3e600523, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=1eabfe33-b922-40ca-a921-b06d3e600523,segment=NetworkSegment(698e6ff0-3fe3-4914-b785-972d8f6cc124),segment_id=698e6ff0-3fe3-4914-b785-972d8f6cc124)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:23:52.867895 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:52.918298 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=1eabfe33-b922-40ca-a921-b06d3e600523,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:53.574245 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-797cde94-e6f9-4a82-ba06-397379fc3a94 req-dcbc5a4b-9229-4cac-8577-216b6377e18a tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:53.575727 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-797cde94-e6f9-4a82-ba06-397379fc3a94 req-dcbc5a4b-9229-4cac-8577-216b6377e18a tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 945 time: 0.0489919 Nov 24 11:23:53.621648 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-797cde94-e6f9-4a82-ba06-397379fc3a94 req-f2095344-0cce-4b7b-9250-ae3b11c9e5ba tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400901 Nov 24 11:23:54.617697 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['1eabfe33-b922-40ca-a921-b06d3e600523'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:23:54.760030 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4927e3c7-3b88-4876-9c56-e466c9abd928 req-65bf4710-e187-48b3-bea3-226fdbe24579 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:54.761650 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4927e3c7-3b88-4876-9c56-e466c9abd928 req-65bf4710-e187-48b3-bea3-226fdbe24579 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 945 time: 0.0652208 Nov 24 11:23:54.815102 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4927e3c7-3b88-4876-9c56-e466c9abd928 req-7bbce59c-54d5-41a5-a604-48592557ef57 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470445 Nov 24 11:23:55.928882 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2406054f-215e-402c-9918-7d94905ac918 req-33eda59b-4ac8-4e6a-a56b-006beffe28ab tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:55.930833 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2406054f-215e-402c-9918-7d94905ac918 req-33eda59b-4ac8-4e6a-a56b-006beffe28ab tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 945 time: 0.0495489 Nov 24 11:23:55.977578 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2406054f-215e-402c-9918-7d94905ac918 req-4b88ffaa-5adc-4d3d-81b2-c089fcc4c7c4 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408170 Nov 24 11:23:56.943853 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 1eabfe33-b922-40ca-a921-b06d3e600523 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:23:57.070263 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 1eabfe33-b922-40ca-a921-b06d3e600523 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:23:57.074990 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 1eabfe33-b922-40ca-a921-b06d3e600523 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:23:57.075389 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:57.095762 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4603798-0cd2-42ee-8699-17f4e9b8000c req-40857b9b-6fe6-4810-8cc1-183c26c51afe tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:57.097311 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c4603798-0cd2-42ee-8699-17f4e9b8000c req-40857b9b-6fe6-4810-8cc1-183c26c51afe tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 945 time: 0.0532155 Nov 24 11:23:57.145425 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c4603798-0cd2-42ee-8699-17f4e9b8000c req-00ada85a-5904-4157-910b-fe6214bc2e5a tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413857 Nov 24 11:23:57.150736 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:57.172935 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '76a1192b-e3f1-48b1-a56a-2b22a5f759b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1eabfe33-b922-40ca-a921-b06d3e600523'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:23:57.175125 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a3897478-dbc6-4b3d-90a4-0775cbf7ed9e" -d '{"events": [{"server_uuid": "76a1192b-e3f1-48b1-a56a-2b22a5f759b6", "name": "network-vif-plugged", "status": "completed", "tag": "1eabfe33-b922-40ca-a921-b06d3e600523"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:23:57.188614 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 1eabfe33-b922-40ca-a921-b06d3e600523, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=1eabfe33-b922-40ca-a921-b06d3e600523,segment=NetworkSegment(698e6ff0-3fe3-4914-b785-972d8f6cc124),segment_id=698e6ff0-3fe3-4914-b785-972d8f6cc124)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:23:57.211371 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:23:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-857286b5-192c-452b-913f-af69491a067e x-openstack-request-id: req-857286b5-192c-452b-913f-af69491a067e {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:23:57.212116 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "76a1192b-e3f1-48b1-a56a-2b22a5f759b6", "name": "network-vif-plugged", "status": "completed", "tag": "1eabfe33-b922-40ca-a921-b06d3e600523", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:23:57.212373 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-857286b5-192c-452b-913f-af69491a067e {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:23:57.212797 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '76a1192b-e3f1-48b1-a56a-2b22a5f759b6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1eabfe33-b922-40ca-a921-b06d3e600523', 'code': 200} Nov 24 11:23:57.290672 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:23:57.340495 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=1eabfe33-b922-40ca-a921-b06d3e600523,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:23:57.347513 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:57.347864 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:57.348209 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:57.348542 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:57.348874 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:57.349206 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:57.349535 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:57.349861 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:57.350187 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:57.350508 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:57.350830 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:57.351150 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:23:58.257056 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa82bef9-74e1-48b8-9ad8-2d0d2ad9d94f req-d98cc262-6e9a-43fd-80ed-e5108ef7ed3a tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:58.259178 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-aa82bef9-74e1-48b8-9ad8-2d0d2ad9d94f req-d98cc262-6e9a-43fd-80ed-e5108ef7ed3a tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 946 time: 0.0483727 Nov 24 11:23:58.306605 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-aa82bef9-74e1-48b8-9ad8-2d0d2ad9d94f req-9c594828-46de-47be-aa7e-63afa6c37b3d tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414104 Nov 24 11:23:59.051098 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf4a1bc-08af-42f8-91ea-798b97aa79ce req-5bcd1aab-d14f-4938-b245-25b78a785db6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:59.052537 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-edf4a1bc-08af-42f8-91ea-798b97aa79ce req-5bcd1aab-d14f-4938-b245-25b78a785db6 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 1099 time: 0.0396190 Nov 24 11:23:59.101291 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-edf4a1bc-08af-42f8-91ea-798b97aa79ce req-35869f1f-9588-476d-8478-b36e8442c1fc service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397971 Nov 24 11:23:59.424620 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-075ea03c-0906-4f94-9348-e73b8d410582 req-2b4f4f7d-baf8-435f-82ce-5e6812165b82 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:23:59.426052 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-075ea03c-0906-4f94-9348-e73b8d410582 req-2b4f4f7d-baf8-435f-82ce-5e6812165b82 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 946 time: 0.0490432 Nov 24 11:23:59.475738 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-075ea03c-0906-4f94-9348-e73b8d410582 req-27f29386-116a-47ae-ae43-2145e6d68cb0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435762 Nov 24 11:24:00.590464 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eab00133-6429-4a9a-962b-e2d6e702c83d req-cac424cf-7838-488d-8207-7c381fab03ff tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:00.591982 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eab00133-6429-4a9a-962b-e2d6e702c83d req-cac424cf-7838-488d-8207-7c381fab03ff tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 946 time: 0.0487671 Nov 24 11:24:00.638101 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eab00133-6429-4a9a-962b-e2d6e702c83d req-ca8caf7a-9189-4b8a-bd07-8ef62dd27729 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403442 Nov 24 11:24:04.161623 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76bdfaea-f3e9-4c15-a20a-852cbd70b877 req-b42ea66c-e419-403d-9f72-61a6302d832f tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:04.163086 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-76bdfaea-f3e9-4c15-a20a-852cbd70b877 req-b42ea66c-e419-403d-9f72-61a6302d832f tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 946 time: 0.0486240 Nov 24 11:24:04.210007 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-76bdfaea-f3e9-4c15-a20a-852cbd70b877 req-39bd481d-d021-417c-b539-913211d88c12 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405807 Nov 24 11:24:05.331239 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c7e2ed9-a973-442c-afe9-71aa8523b675 req-f9747797-32af-4bbf-868a-20413e1a0f3c tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:05.333496 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7c7e2ed9-a973-442c-afe9-71aa8523b675 req-f9747797-32af-4bbf-868a-20413e1a0f3c tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 946 time: 0.0526178 Nov 24 11:24:05.381422 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7c7e2ed9-a973-442c-afe9-71aa8523b675 req-3448cf01-48da-4a20-8aac-c3e3e8c3b21d tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420735 Nov 24 11:24:05.584333 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c9547cc-1172-4066-808c-aeb2bdb1b5f1 req-966cedbe-d818-4d81-aa25-5ab2be7c1df3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:05.585740 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-0c9547cc-1172-4066-808c-aeb2bdb1b5f1 req-966cedbe-d818-4d81-aa25-5ab2be7c1df3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.86 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 946 time: 0.0489585 Nov 24 11:24:05.674069 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-0c9547cc-1172-4066-808c-aeb2bdb1b5f1 req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Deleting port 1eabfe33-b922-40ca-a921-b06d3e600523 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:05.674452 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-0c9547cc-1172-4066-808c-aeb2bdb1b5f1 req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:05.763456 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-0c9547cc-1172-4066-808c-aeb2bdb1b5f1 req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] For port 1eabfe33-b922-40ca-a921-b06d3e600523, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=1eabfe33-b922-40ca-a921-b06d3e600523,segment=NetworkSegment(698e6ff0-3fe3-4914-b785-972d8f6cc124),segment_id=698e6ff0-3fe3-4914-b785-972d8f6cc124)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:05.763811 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-0c9547cc-1172-4066-808c-aeb2bdb1b5f1 req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:05.775821 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-0c9547cc-1172-4066-808c-aeb2bdb1b5f1 req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Calling delete_port for 1eabfe33-b922-40ca-a921-b06d3e600523 owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:05.959125 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-0c9547cc-1172-4066-808c-aeb2bdb1b5f1 req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:05.972252 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['1eabfe33-b922-40ca-a921-b06d3e600523'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:24:05.988237 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Pushing event deleted for resources: {'Port': ['ID=1eabfe33-b922-40ca-a921-b06d3e600523,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:06.000734 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:06.001079 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:06.001421 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:06.001746 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:06.002071 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:06.002399 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:06.002722 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:06.003042 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:06.003382 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:06.003697 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:06.004011 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:06.004323 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:06.036978 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-0c9547cc-1172-4066-808c-aeb2bdb1b5f1 req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] No DVR routers for this DVR port 1eabfe33-b922-40ca-a921-b06d3e600523 on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:24:06.039435 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-0c9547cc-1172-4066-808c-aeb2bdb1b5f1 req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:06.042906 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-0c9547cc-1172-4066-808c-aeb2bdb1b5f1 req-33918e99-76fd-44b3-b542-0021218768d0 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.86 "DELETE /v2.0/ports/1eabfe33-b922-40ca-a921-b06d3e600523 HTTP/1.1" status: 204 len: 173 time: 0.4508252 Nov 24 11:24:06.043353 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '76a1192b-e3f1-48b1-a56a-2b22a5f759b6', 'name': 'network-vif-deleted', 'tag': '1eabfe33-b922-40ca-a921-b06d3e600523'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:24:06.045545 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5689a44c-75bd-4056-ba3d-88bd7d620593" -d '{"events": [{"server_uuid": "76a1192b-e3f1-48b1-a56a-2b22a5f759b6", "name": "network-vif-deleted", "tag": "1eabfe33-b922-40ca-a921-b06d3e600523"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:24:06.082332 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:24:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3e8b2b51-c73e-4e72-be23-b24b47159097 x-openstack-request-id: req-3e8b2b51-c73e-4e72-be23-b24b47159097 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:24:06.082639 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "76a1192b-e3f1-48b1-a56a-2b22a5f759b6", "name": "network-vif-deleted", "tag": "1eabfe33-b922-40ca-a921-b06d3e600523", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:24:06.082904 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-3e8b2b51-c73e-4e72-be23-b24b47159097 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:24:06.083312 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '76a1192b-e3f1-48b1-a56a-2b22a5f759b6', 'name': 'network-vif-deleted', 'tag': '1eabfe33-b922-40ca-a921-b06d3e600523', 'status': 'completed', 'code': 200} Nov 24 11:24:06.486122 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9c1770dd-b07d-491d-b826-61f8ac204ad6 req-63e6a11b-a86d-44ca-b28c-a8d5eb04e650 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=76a1192b-e3f1-48b1-a56a-2b22a5f759b6 HTTP/1.1" status: 200 len: 210 time: 0.0266910 Nov 24 11:24:07.756835 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-9d9f09e7-41db-4ad9-b039-de85c67dffe2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:07.758308 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-9d9f09e7-41db-4ad9-b039-de85c67dffe2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/networks?id=c3773775-201b-4142-b6ec-b6fb9be9b452 HTTP/1.1" status: 200 len: 808 time: 0.1060619 Nov 24 11:24:07.774765 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-e9f10d5e-e7ad-4ebe-9995-e6884c67f1e4 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/quotas/603b0bf1aabf49efb7ac8be965b64567 HTTP/1.1" status: 200 len: 375 time: 0.0099461 Nov 24 11:24:07.807160 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-ed67ac1e-e549-4774-acbe-22bfcf928ff8 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=603b0bf1aabf49efb7ac8be965b64567&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0262208 Nov 24 11:24:07.897395 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-e6a86a44-dd84-486f-9193-c3a0cc9c66d2 service neutron] 10.222.0.76 "GET /v2.0/networks/c3773775-201b-4142-b6ec-b6fb9be9b452?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831020 Nov 24 11:24:07.993368 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-748a58b4-6619-4703-bdb3-3f733ebe1c0a service neutron] 10.222.0.76 "GET /v2.0/networks/c3773775-201b-4142-b6ec-b6fb9be9b452?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0899661 Nov 24 11:24:08.220445 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-848a5187-8925-4a4e-bfd5-a5b001db7405 req-9f549074-5608-48bd-b9e0-20583353a482 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 210 time: 0.0268767 Nov 24 11:24:08.762339 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c1834b53-12a3-4d02-a71e-345f8ea3a66f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:09.241736 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:09.324003 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f82f23e6-9048-47a6-b961-67f96ef8e1dc req-e748ca2c-a196-483b-b774-4450b530da95 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 210 time: 0.0267477 Nov 24 11:24:09.573980 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-621c3823-b1bf-4919-87d4-f94bc6ff5382 req-06c502d6-1125-4078-bafa-7387a4984b68 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:09.576154 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-621c3823-b1bf-4919-87d4-f94bc6ff5382 req-06c502d6-1125-4078-bafa-7387a4984b68 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 945 time: 0.0560527 Nov 24 11:24:09.623312 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-621c3823-b1bf-4919-87d4-f94bc6ff5382 req-8c8d8dc8-e5f9-4ef0-8677-85c94def7aae tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412185 Nov 24 11:24:10.135861 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-528420a8-fe00-4a09-a716-af91632c3aaa tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:10.137290 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-528420a8-fe00-4a09-a716-af91632c3aaa tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.86 "GET /v2.0/networks?id=c3773775-201b-4142-b6ec-b6fb9be9b452 HTTP/1.1" status: 200 len: 808 time: 0.1028116 Nov 24 11:24:10.152593 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Request body: {'port': {'device_id': '48fda564-aef1-4a00-81cb-ec4aaabae799', 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452', 'admin_state_up': True, 'tenant_id': '603b0bf1aabf49efb7ac8be965b64567'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:24:10.341862 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Made reservation on behalf of 603b0bf1aabf49efb7ac8be965b64567 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:24:10.345695 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:10.405600 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 1eabfe33-b922-40ca-a921-b06d3e600523 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:24:10.428711 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 1eabfe33-b922-40ca-a921-b06d3e600523 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:24:10.429160 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 1eabfe33-b922-40ca-a921-b06d3e600523 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:24:10.433456 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6ea5aaee-6391-40ce-906d-2b32ff5e386a req-1aa4eba1-ffe7-457c-b8d2-af236e5fca81 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 210 time: 0.0368426 Nov 24 11:24:10.480559 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Allocated IP 172.20.0.8 (c3773775-201b-4142-b6ec-b6fb9be9b452/458596b0-9c4c-4b58-86f1-e732479ac853/27614d4b-dae2-45dc-a35b-985ed2999cb3) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:24:10.627669 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:10.714375 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:10.738747 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bce442c5-c2d9-4999-a604-594b62e77d93 req-34e279e0-a43e-4b6b-981b-988eaf99a3c2 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:10.740252 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bce442c5-c2d9-4999-a604-594b62e77d93 req-34e279e0-a43e-4b6b-981b-988eaf99a3c2 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 945 time: 0.0496991 Nov 24 11:24:10.755100 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Network c3773775-201b-4142-b6ec-b6fb9be9b452 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:24:10.760651 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:24:10.763180 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:24:10.793353 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bce442c5-c2d9-4999-a604-594b62e77d93 req-b7bace85-c61e-4784-8dae-e7f75d20d324 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469191 Nov 24 11:24:10.795848 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Pushing event updated for resources: {'Port': ['ID=27614d4b-dae2-45dc-a35b-985ed2999cb3,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:10.818754 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:10.819372 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:10.869699 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-bd75efb9-c717-4a48-b1ca-147aa54251f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7216258 Nov 24 11:24:10.882403 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Request body: {'port': {'device_id': '48fda564-aef1-4a00-81cb-ec4aaabae799', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:24:10.937247 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:11.148237 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d3c35b5-664e-4597-81cc-f5cc3f166999 req-38135010-a766-409c-b70d-10edce2b19c4 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:11.149752 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0d3c35b5-664e-4597-81cc-f5cc3f166999 req-38135010-a766-409c-b70d-10edce2b19c4 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.86 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 945 time: 0.0542042 Nov 24 11:24:11.150454 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6144e8b1-4d74-453d-962a-c6d023140974 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:11.243329 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [req-0d3c35b5-664e-4597-81cc-f5cc3f166999 req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Deleting port 99fa064b-6898-411f-95e1-d3974abc2c67 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:11.243576 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-0d3c35b5-664e-4597-81cc-f5cc3f166999 req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:11.338643 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [req-0d3c35b5-664e-4597-81cc-f5cc3f166999 req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] For port 99fa064b-6898-411f-95e1-d3974abc2c67, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=99fa064b-6898-411f-95e1-d3974abc2c67,segment=NetworkSegment(d17edd0c-57ba-4458-9e65-d12987ea086d),segment_id=d17edd0c-57ba-4458-9e65-d12987ea086d)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:11.339080 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-0d3c35b5-664e-4597-81cc-f5cc3f166999 req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:11.350987 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [req-0d3c35b5-664e-4597-81cc-f5cc3f166999 req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Calling delete_port for 99fa064b-6898-411f-95e1-d3974abc2c67 owned by compute:nova {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:11.455674 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 27614d4b-dae2-45dc-a35b-985ed2999cb3 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:24:11.464749 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:11.547824 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Transition to ACTIVE for port object 27614d4b-dae2-45dc-a35b-985ed2999cb3 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:24:11.553252 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-726e8b7c-a637-47ea-91c4-54f441f095bc req-e7babf20-09c0-4afb-a99a-843ab3858cba tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:11.554711 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-726e8b7c-a637-47ea-91c4-54f441f095bc req-e7babf20-09c0-4afb-a99a-843ab3858cba tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 931 time: 0.0521531 Nov 24 11:24:11.555784 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-0d3c35b5-664e-4597-81cc-f5cc3f166999 req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:11.568701 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['99fa064b-6898-411f-95e1-d3974abc2c67'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:24:11.592239 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Pushing event deleted for resources: {'Port': ['ID=99fa064b-6898-411f-95e1-d3974abc2c67,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:11.601932 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:11.612979 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:11.613326 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:11.613662 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:11.613998 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:11.614324 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:11.614651 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:11.614974 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:11.615314 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:11.615639 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:11.615956 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:11.616277 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:11.616645 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:24:11.656176 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Pushing event updated for resources: {'Port': ['ID=27614d4b-dae2-45dc-a35b-985ed2999cb3,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:11.661076 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [req-0d3c35b5-664e-4597-81cc-f5cc3f166999 req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] No DVR routers for this DVR port 99fa064b-6898-411f-95e1-d3974abc2c67 on host hv-cinder-80403 {{(pid=103244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:24:11.663900 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-0d3c35b5-664e-4597-81cc-f5cc3f166999 req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:11.667315 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0d3c35b5-664e-4597-81cc-f5cc3f166999 req-1d30010a-ceb6-42b0-8025-1c5348855b3a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.86 "DELETE /v2.0/ports/99fa064b-6898-411f-95e1-d3974abc2c67 HTTP/1.1" status: 204 len: 173 time: 0.5116169 Nov 24 11:24:11.667790 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876', 'name': 'network-vif-deleted', 'tag': '99fa064b-6898-411f-95e1-d3974abc2c67'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:24:11.670041 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2283151f-1189-4c0f-9c85-198c6883f93a" -d '{"events": [{"server_uuid": "bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876", "name": "network-vif-deleted", "tag": "99fa064b-6898-411f-95e1-d3974abc2c67"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:24:11.686094 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-726e8b7c-a637-47ea-91c4-54f441f095bc req-d15d7d34-7261-4e2c-bbe0-0389b3b2b9f5 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1216340 Nov 24 11:24:11.711603 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:24:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-37d5ff4e-05d5-4473-a709-e8f2e2533f26 x-openstack-request-id: req-37d5ff4e-05d5-4473-a709-e8f2e2533f26 {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:24:11.711603 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876", "name": "network-vif-deleted", "tag": "99fa064b-6898-411f-95e1-d3974abc2c67", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:24:11.711603 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-37d5ff4e-05d5-4473-a709-e8f2e2533f26 {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:24:11.711603 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876', 'name': 'network-vif-deleted', 'tag': '99fa064b-6898-411f-95e1-d3974abc2c67', 'status': 'completed', 'code': 200} Nov 24 11:24:11.733624 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Attempting to bind port 27614d4b-dae2-45dc-a35b-985ed2999cb3 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:24:11.733994 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Attempting to bind port 27614d4b-dae2-45dc-a35b-985ed2999cb3 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': '698e6ff0-3fe3-4914-b785-972d8f6cc124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1217, 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:24:11.736376 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Attempting to bind port 27614d4b-dae2-45dc-a35b-985ed2999cb3 on network c3773775-201b-4142-b6ec-b6fb9be9b452 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:24:11.739198 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Port 27614d4b-dae2-45dc-a35b-985ed2999cb3 on network c3773775-201b-4142-b6ec-b6fb9be9b452 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:24:11.739601 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Attempting to bind port 27614d4b-dae2-45dc-a35b-985ed2999cb3 on network c3773775-201b-4142-b6ec-b6fb9be9b452 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:24:11.744893 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:24:11.745238 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Checking segment: {'id': '698e6ff0-3fe3-4914-b785-972d8f6cc124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1217, 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:24:11.745619 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Bound using segment: {'id': '698e6ff0-3fe3-4914-b785-972d8f6cc124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1217, 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:24:11.746037 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Bound port: 27614d4b-dae2-45dc-a35b-985ed2999cb3, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '698e6ff0-3fe3-4914-b785-972d8f6cc124', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1217, 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:24:11.746381 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:11.813354 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] For port 27614d4b-dae2-45dc-a35b-985ed2999cb3, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:24:11.816471 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] For port 27614d4b-dae2-45dc-a35b-985ed2999cb3, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=27614d4b-dae2-45dc-a35b-985ed2999cb3,segment=NetworkSegment(698e6ff0-3fe3-4914-b785-972d8f6cc124),segment_id=698e6ff0-3fe3-4914-b785-972d8f6cc124)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:24:11.886077 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:11.894870 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-990e9682-a126-48bc-93ee-83a661b5ab1f req-727359ae-3282-4cf4-ac05-9722bdc24fac tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=bcf23a7f-7adb-4035-b0f2-3eb2a6cc9876 HTTP/1.1" status: 200 len: 210 time: 0.0299585 Nov 24 11:24:11.925234 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:11.925856 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:11.933698 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] 10.222.0.86 "PUT /v2.0/ports/27614d4b-dae2-45dc-a35b-985ed2999cb3 HTTP/1.1" status: 200 len: 1093 time: 1.0489163 Nov 24 11:24:11.933698 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '48fda564-aef1-4a00-81cb-ec4aaabae799', 'tag': '27614d4b-dae2-45dc-a35b-985ed2999cb3'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:24:11.933698 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6e1f3a91-3c0e-4274-a60b-1cbde7a67fec" -d '{"events": [{"name": "network-changed", "server_uuid": "48fda564-aef1-4a00-81cb-ec4aaabae799", "tag": "27614d4b-dae2-45dc-a35b-985ed2999cb3"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:24:11.951132 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe8de4cd-c26d-4ed9-8b9a-d9132d4f9137 service neutron] Pushing event updated for resources: {'Port': ['ID=27614d4b-dae2-45dc-a35b-985ed2999cb3,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:11.969185 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:24:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ce6320c-0b9c-4d1e-a857-91c400e4a761 x-openstack-request-id: req-4ce6320c-0b9c-4d1e-a857-91c400e4a761 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:24:11.969465 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "48fda564-aef1-4a00-81cb-ec4aaabae799", "tag": "27614d4b-dae2-45dc-a35b-985ed2999cb3", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:24:11.969722 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-4ce6320c-0b9c-4d1e-a857-91c400e4a761 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:24:11.970119 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '48fda564-aef1-4a00-81cb-ec4aaabae799', 'tag': '27614d4b-dae2-45dc-a35b-985ed2999cb3', 'status': 'completed', 'code': 200} Nov 24 11:24:12.036065 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e1f3a91-3c0e-4274-a60b-1cbde7a67fec req-ba895b0d-0da1-4c5f-9cc9-4d32c76691ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:12.037560 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-6e1f3a91-3c0e-4274-a60b-1cbde7a67fec req-ba895b0d-0da1-4c5f-9cc9-4d32c76691ca service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=603b0bf1aabf49efb7ac8be965b64567&device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 1096 time: 0.0457828 Nov 24 11:24:12.134695 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e1f3a91-3c0e-4274-a60b-1cbde7a67fec req-a3a0ce82-567f-4bb0-ba3b-2f907eda61e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:12.136223 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-6e1f3a91-3c0e-4274-a60b-1cbde7a67fec req-a3a0ce82-567f-4bb0-ba3b-2f907eda61e9 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=603b0bf1aabf49efb7ac8be965b64567&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0897453 Nov 24 11:24:12.234845 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e1f3a91-3c0e-4274-a60b-1cbde7a67fec req-ec8a15a6-5d1b-4f57-8e47-e1ec3a2ddf3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:12.237126 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-6e1f3a91-3c0e-4274-a60b-1cbde7a67fec req-ec8a15a6-5d1b-4f57-8e47-e1ec3a2ddf3b service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.0918813 Nov 24 11:24:12.315889 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-e04ec468-6286-43aa-980c-70b94cef5ff8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:12.317339 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-e04ec468-6286-43aa-980c-70b94cef5ff8 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=603b0bf1aabf49efb7ac8be965b64567&device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 1096 time: 0.0400732 Nov 24 11:24:12.362417 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-d972addf-3cee-4ee1-b644-e6b3b235d369 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=27614d4b-dae2-45dc-a35b-985ed2999cb3 HTTP/1.1" status: 200 len: 217 time: 0.0359693 Nov 24 11:24:12.414485 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-a3e1c43a-bb11-4d1c-991b-4e1abfbe7069 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:12.416022 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-a3e1c43a-bb11-4d1c-991b-4e1abfbe7069 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=458596b0-9c4c-4b58-86f1-e732479ac853 HTTP/1.1" status: 200 len: 848 time: 0.0463905 Nov 24 11:24:12.451246 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-112499da-dbde-4b2e-88be-9d42dd7a8ee6 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=c3773775-201b-4142-b6ec-b6fb9be9b452&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0263052 Nov 24 11:24:12.470328 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:12.544832 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-0ffbc2b7-de25-4131-969d-99ef2560b291 service neutron] 10.222.0.86 "GET /v2.0/networks/c3773775-201b-4142-b6ec-b6fb9be9b452?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0856562 Nov 24 11:24:12.634039 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-eefe4633-2c12-4068-aa27-cb9b2380ccd7 req-7b902fe0-0aee-45ec-995f-e66497af78d5 service neutron] 10.222.0.86 "GET /v2.0/networks/c3773775-201b-4142-b6ec-b6fb9be9b452?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819025 Nov 24 11:24:12.803585 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dc09cbe-7ab4-4b8b-b9b4-dc1157103802 req-74dc8573-6b6b-449d-9045-e6bd72e215ed tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:12.805049 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3dc09cbe-7ab4-4b8b-b9b4-dc1157103802 req-74dc8573-6b6b-449d-9045-e6bd72e215ed tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 943 time: 0.0494967 Nov 24 11:24:12.851787 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3dc09cbe-7ab4-4b8b-b9b4-dc1157103802 req-e0c8e6bc-ca2a-4d01-b5a3-4f31aeb08986 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407434 Nov 24 11:24:13.068713 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:24:13.668427 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34288) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:13.820110 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Deleting port ca24e93b-012b-4295-8eef-7fe5ea88cacd {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:13.820782 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:13.897465 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:13.897783 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:13.909886 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Calling delete_port for ca24e93b-012b-4295-8eef-7fe5ea88cacd owned by network:floatingip {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:14.013253 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-737d03c7-4fa3-43e2-b6ac-c2b1202e7f02 req-62636394-f010-4463-a364-78462471a807 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:14.014713 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-737d03c7-4fa3-43e2-b6ac-c2b1202e7f02 req-62636394-f010-4463-a364-78462471a807 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 943 time: 0.0954344 Nov 24 11:24:14.050225 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:14.090148 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-737d03c7-4fa3-43e2-b6ac-c2b1202e7f02 req-d336b9c6-3202-461b-9452-6b4bfd2ddbed tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688372 Nov 24 11:24:14.196050 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:14.222061 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event deleted for resources: {'Port': ['ID=ca24e93b-012b-4295-8eef-7fe5ea88cacd,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:14.282563 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for floatingip, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:14.282797 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.l3_db [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Floating IP 6191c1d8-3c71-4a1d-bd3b-0ff3b9486c4b disassociated (deleted). External IP: 172.27.3.101, port: 4309383c-b778-44aa-bd64-d0a29f77fb4d. Nov 24 11:24:14.483349 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Router 98c34a41-9cdb-48f6-bfa4-2ed94016563f has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:24:14.589053 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:24:14.593842 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:14.598630 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60a7bcb2-88ca-4f35-8fad-bce6cba33c25 None None] Sync routers for ids ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:24:14.607576 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60a7bcb2-88ca-4f35-8fad-bce6cba33c25 None None] Routers {'98c34a41-9cdb-48f6-bfa4-2ed94016563f'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:24:14.608183 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-60a7bcb2-88ca-4f35-8fad-bce6cba33c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:24:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:14.622249 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-203c0369-9481-4ec6-a1ae-7255782d81ad tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "DELETE /v2.0/floatingips/6191c1d8-3c71-4a1d-bd3b-0ff3b9486c4b HTTP/1.1" status: 204 len: 168 time: 0.9525940 Nov 24 11:24:14.623623 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:24:14.625415 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13919e2f-1645-40c3-81af-11ffdefcac2f" -d '{"events": [{"name": "network-changed", "server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:24:14.662693 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:24:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cd87f117-03cf-4a00-b918-9f05266f6a32 x-openstack-request-id: req-cd87f117-03cf-4a00-b918-9f05266f6a32 {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:24:14.662985 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:24:14.663256 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-cd87f117-03cf-4a00-b918-9f05266f6a32 {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:24:14.663684 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'status': 'completed', 'code': 200} Nov 24 11:24:14.716953 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-60a7bcb2-88ca-4f35-8fad-bce6cba33c25 None None] Set router 98c34a41-9cdb-48f6-bfa4-2ed94016563f gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:24:14.815857 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:14.934632 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-60a7bcb2-88ca-4f35-8fad-bce6cba33c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:26Z', 'revision_number': 4, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': 'f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d', 'name': '', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'mac_address': 'fa:16:3e:5e:d7:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:25Z', 'updated_at': '2021-11-24T11:19:30Z', 'revision_number': 5, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'subnets': [{'id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:14.959815 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60a7bcb2-88ca-4f35-8fad-bce6cba33c25 None None] Checking router: 98c34a41-9cdb-48f6-bfa4-2ed94016563f for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:24:14.968691 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-60a7bcb2-88ca-4f35-8fad-bce6cba33c25 None None] Routers {'98c34a41-9cdb-48f6-bfa4-2ed94016563f'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:24:14.969291 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-60a7bcb2-88ca-4f35-8fad-bce6cba33c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:24:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:15.010860 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4420ed99-fd23-4497-a6b2-6a9d0bcc78b1 req-7399600b-fc71-4de5-9665-1533674be935 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:15.012369 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4420ed99-fd23-4497-a6b2-6a9d0bcc78b1 req-7399600b-fc71-4de5-9665-1533674be935 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0532999 Nov 24 11:24:15.061586 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4420ed99-fd23-4497-a6b2-6a9d0bcc78b1 req-bf2195cb-d59e-4bee-9069-ccd723fc0efe tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430975 Nov 24 11:24:15.076304 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-60a7bcb2-88ca-4f35-8fad-bce6cba33c25 None None] Set router 98c34a41-9cdb-48f6-bfa4-2ed94016563f gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:24:15.204797 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63f9e9f6-3047-4d23-a877-18ce08416e71 req-d7d2d68a-a36b-4032-b1d9-5c4210b0692f tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:15.206329 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-63f9e9f6-3047-4d23-a877-18ce08416e71 req-d7d2d68a-a36b-4032-b1d9-5c4210b0692f tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 943 time: 0.0481117 Nov 24 11:24:15.254050 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-63f9e9f6-3047-4d23-a877-18ce08416e71 req-2bef3dd8-5928-40cc-bfe7-d3241cb7a1b7 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410926 Nov 24 11:24:15.277872 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-60a7bcb2-88ca-4f35-8fad-bce6cba33c25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:26Z', 'revision_number': 4, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': 'f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d', 'name': '', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'mac_address': 'fa:16:3e:5e:d7:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:25Z', 'updated_at': '2021-11-24T11:19:30Z', 'revision_number': 5, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'subnets': [{'id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:15.303936 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-60a7bcb2-88ca-4f35-8fad-bce6cba33c25 None None] The sync data for ids ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'] in dv-cinder-804035-18-iscsi is: [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:26Z', 'revision_number': 4, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': 'f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d', 'name': '', 'network_id': '6b81a015-9685-4892-8d78-2a713f48dc53', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'mac_address': 'fa:16:3e:5e:d7:3f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_interface', 'standard_attr_id': 451, 'fixed_ips': [{'subnet_id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:25Z', 'updated_at': '2021-11-24T11:19:30Z', 'revision_number': 5, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'subnets': [{'id': '2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:24:15.352016 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99fa064b-6898-411f-95e1-d3974abc2c67 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:24:15.378154 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 99fa064b-6898-411f-95e1-d3974abc2c67 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:24:15.378695 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 99fa064b-6898-411f-95e1-d3974abc2c67 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:24:15.515901 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dcddf24-02fe-43af-b906-5a33e793ee91 None None] New status for floating IP 6191c1d8-3c71-4a1d-bd3b-0ff3b9486c4b: DOWN {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:24:16.177027 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a23c02f0-6303-4133-89ca-b43da8442031 req-1bdb20ef-1a43-4fd5-8922-97ec66324547 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:16.178464 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a23c02f0-6303-4133-89ca-b43da8442031 req-1bdb20ef-1a43-4fd5-8922-97ec66324547 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0510232 Nov 24 11:24:16.227076 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a23c02f0-6303-4133-89ca-b43da8442031 req-90a361f1-277b-4e11-90ad-fed1f5c53d67 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420561 Nov 24 11:24:16.371518 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c436403-e10f-41a5-9e18-23e65f873e77 req-147d1053-336d-4089-ae36-f89b22d5a630 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:16.373181 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3c436403-e10f-41a5-9e18-23e65f873e77 req-147d1053-336d-4089-ae36-f89b22d5a630 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 943 time: 0.0537026 Nov 24 11:24:16.383432 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13919e2f-1645-40c3-81af-11ffdefcac2f req-7f7bb909-9919-45e3-a196-207cf44c48fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:16.392964 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-13919e2f-1645-40c3-81af-11ffdefcac2f req-7f7bb909-9919-45e3-a196-207cf44c48fc service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=89e9b1abd4814b03ae8c95c5918bef03&device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 1098 time: 0.0427632 Nov 24 11:24:16.425135 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3c436403-e10f-41a5-9e18-23e65f873e77 req-7566d694-4885-4d3e-be03-99514777490a tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449624 Nov 24 11:24:16.483747 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13919e2f-1645-40c3-81af-11ffdefcac2f req-73861eca-bdaf-4239-9c35-1d5005fadad2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:16.485265 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-13919e2f-1645-40c3-81af-11ffdefcac2f req-73861eca-bdaf-4239-9c35-1d5005fadad2 service neutron] 10.222.0.86 "GET /v2.0/networks?id=6b81a015-9685-4892-8d78-2a713f48dc53 HTTP/1.1" status: 200 len: 911 time: 0.0915015 Nov 24 11:24:16.527095 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-13919e2f-1645-40c3-81af-11ffdefcac2f req-15e7c586-7adf-4b65-a1a0-55f5e581a840 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d HTTP/1.1" status: 200 len: 217 time: 0.0339518 Nov 24 11:24:16.528963 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 27614d4b-dae2-45dc-a35b-985ed2999cb3 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:24:16.580418 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13919e2f-1645-40c3-81af-11ffdefcac2f req-a0a25d99-cb0c-4932-b9b3-5a1c0efba26d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:16.581925 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-13919e2f-1645-40c3-81af-11ffdefcac2f req-a0a25d99-cb0c-4932-b9b3-5a1c0efba26d service neutron] 10.222.0.86 "GET /v2.0/subnets?id=2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c HTTP/1.1" status: 200 len: 848 time: 0.0472639 Nov 24 11:24:16.628631 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 27614d4b-dae2-45dc-a35b-985ed2999cb3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=27614d4b-dae2-45dc-a35b-985ed2999cb3,segment=NetworkSegment(698e6ff0-3fe3-4914-b785-972d8f6cc124),segment_id=698e6ff0-3fe3-4914-b785-972d8f6cc124)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:16.632343 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13919e2f-1645-40c3-81af-11ffdefcac2f req-a7080690-ee04-4302-92d8-48c4bcb50567 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:16.633818 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-13919e2f-1645-40c3-81af-11ffdefcac2f req-a7080690-ee04-4302-92d8-48c4bcb50567 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=6b81a015-9685-4892-8d78-2a713f48dc53&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0440028 Nov 24 11:24:16.640315 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '27614d4b-dae2-45dc-a35b-985ed2999cb3', 'network_id': 'c3773775-201b-4142-b6ec-b6fb9be9b452', 'port_id': '27614d4b-dae2-45dc-a35b-985ed2999cb3', 'mac_address': 'fa:16:3e:92:3c:2e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1217, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '458596b0-9c4c-4b58-86f1-e732479ac853', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:24:16.677301 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:16.689818 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 27614d4b-dae2-45dc-a35b-985ed2999cb3 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:24:16.708419 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 27614d4b-dae2-45dc-a35b-985ed2999cb3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=27614d4b-dae2-45dc-a35b-985ed2999cb3,segment=NetworkSegment(698e6ff0-3fe3-4914-b785-972d8f6cc124),segment_id=698e6ff0-3fe3-4914-b785-972d8f6cc124)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:16.723313 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-13919e2f-1645-40c3-81af-11ffdefcac2f req-6846f97c-d058-415c-b31f-7ef897bfd10c service neutron] 10.222.0.86 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802813 Nov 24 11:24:16.773373 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:16.820085 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-13919e2f-1645-40c3-81af-11ffdefcac2f req-9de63a43-e9f5-4d66-8570-4db3b7d99fdb service neutron] 10.222.0.86 "GET /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886488 Nov 24 11:24:16.833446 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=27614d4b-dae2-45dc-a35b-985ed2999cb3,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:17.010400 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['27614d4b-dae2-45dc-a35b-985ed2999cb3'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:24:17.341571 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29eeb28f-ee17-4cf7-8bb2-10613d08111c req-3a72172a-8bc3-4a4c-bd66-81ef73928065 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:17.343069 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-29eeb28f-ee17-4cf7-8bb2-10613d08111c req-3a72172a-8bc3-4a4c-bd66-81ef73928065 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0486739 Nov 24 11:24:17.395649 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-29eeb28f-ee17-4cf7-8bb2-10613d08111c req-05285c43-42fc-451f-a692-8b0954584ffc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/security-groups?id=cfe5fa37-1c99-4d49-a45d-e098df726cee&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467494 Nov 24 11:24:17.540574 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-189e6215-0edc-4ba5-900d-fa6c0b614990 req-8bd43a1b-71a8-4011-b748-53ab7de61b56 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:17.541946 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-189e6215-0edc-4ba5-900d-fa6c0b614990 req-8bd43a1b-71a8-4011-b748-53ab7de61b56 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 944 time: 0.0490792 Nov 24 11:24:17.592112 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-189e6215-0edc-4ba5-900d-fa6c0b614990 req-a69088ab-9666-4610-a648-964ad5f2dc70 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440702 Nov 24 11:24:17.970599 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97b760fc-1ee1-45c8-ae06-ddbb5586f1be req-044f7b7b-94c0-47ec-85ec-aa7c4cfb6a5d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:17.972092 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-97b760fc-1ee1-45c8-ae06-ddbb5586f1be req-044f7b7b-94c0-47ec-85ec-aa7c4cfb6a5d tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.86 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 945 time: 0.0494161 Nov 24 11:24:18.070170 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-97b760fc-1ee1-45c8-ae06-ddbb5586f1be req-0656ec57-7fd5-4b7a-b4d9-936257408dda tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Deleting port 4309383c-b778-44aa-bd64-d0a29f77fb4d {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:18.070530 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-97b760fc-1ee1-45c8-ae06-ddbb5586f1be req-0656ec57-7fd5-4b7a-b4d9-936257408dda tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:18.157677 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-97b760fc-1ee1-45c8-ae06-ddbb5586f1be req-0656ec57-7fd5-4b7a-b4d9-936257408dda tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] For port 4309383c-b778-44aa-bd64-d0a29f77fb4d, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=4309383c-b778-44aa-bd64-d0a29f77fb4d,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:18.158028 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-97b760fc-1ee1-45c8-ae06-ddbb5586f1be req-0656ec57-7fd5-4b7a-b4d9-936257408dda tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:18.170979 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-97b760fc-1ee1-45c8-ae06-ddbb5586f1be req-0656ec57-7fd5-4b7a-b4d9-936257408dda tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Calling delete_port for 4309383c-b778-44aa-bd64-d0a29f77fb4d owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:18.384370 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-97b760fc-1ee1-45c8-ae06-ddbb5586f1be req-0656ec57-7fd5-4b7a-b4d9-936257408dda tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:18.416945 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0656ec57-7fd5-4b7a-b4d9-936257408dda tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event deleted for resources: {'Port': ['ID=4309383c-b778-44aa-bd64-d0a29f77fb4d,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:18.463759 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-97b760fc-1ee1-45c8-ae06-ddbb5586f1be req-0656ec57-7fd5-4b7a-b4d9-936257408dda tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] No DVR routers for this DVR port 4309383c-b778-44aa-bd64-d0a29f77fb4d on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:24:18.466833 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-97b760fc-1ee1-45c8-ae06-ddbb5586f1be req-0656ec57-7fd5-4b7a-b4d9-936257408dda tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:18.470412 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-97b760fc-1ee1-45c8-ae06-ddbb5586f1be req-0656ec57-7fd5-4b7a-b4d9-936257408dda tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.86 "DELETE /v2.0/ports/4309383c-b778-44aa-bd64-d0a29f77fb4d HTTP/1.1" status: 204 len: 173 time: 0.4921978 Nov 24 11:24:18.470853 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'name': 'network-vif-deleted', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:24:18.473125 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f83e09ac-9f29-4081-a9cc-76849b533f3f" -d '{"events": [{"server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "name": "network-vif-deleted", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:24:18.494562 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-06723359-b130-40e9-9a68-6ec4ede61910 req-afba3b76-6c01-4cf5-a584-96939e9f74c2 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 210 time: 0.0262570 Nov 24 11:24:18.509172 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:24:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78c218d5-2432-48f6-8586-b075f4543eda x-openstack-request-id: req-78c218d5-2432-48f6-8586-b075f4543eda {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:24:18.509521 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "19240268-0de5-4be0-9b3e-745da67e3b50", "name": "network-vif-deleted", "tag": "4309383c-b778-44aa-bd64-d0a29f77fb4d", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:24:18.509776 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-78c218d5-2432-48f6-8586-b075f4543eda {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:24:18.510173 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '19240268-0de5-4be0-9b3e-745da67e3b50', 'name': 'network-vif-deleted', 'tag': '4309383c-b778-44aa-bd64-d0a29f77fb4d', 'status': 'completed', 'code': 200} Nov 24 11:24:18.542934 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 27614d4b-dae2-45dc-a35b-985ed2999cb3 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:24:18.667455 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 27614d4b-dae2-45dc-a35b-985ed2999cb3 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:24:18.671484 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 27614d4b-dae2-45dc-a35b-985ed2999cb3 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:24:18.671859 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:18.709668 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88cc9cb5-b934-4ef2-8539-e747b97fd091 req-d7e672ab-3b89-4b14-845b-52027e15d417 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:18.711077 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-88cc9cb5-b934-4ef2-8539-e747b97fd091 req-d7e672ab-3b89-4b14-845b-52027e15d417 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 944 time: 0.0492706 Nov 24 11:24:18.761945 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:18.780358 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-88cc9cb5-b934-4ef2-8539-e747b97fd091 req-3fd01084-a5f1-4179-a67f-99c67c48bb05 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595009 Nov 24 11:24:18.815653 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 27614d4b-dae2-45dc-a35b-985ed2999cb3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=27614d4b-dae2-45dc-a35b-985ed2999cb3,segment=NetworkSegment(698e6ff0-3fe3-4914-b785-972d8f6cc124),segment_id=698e6ff0-3fe3-4914-b785-972d8f6cc124)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:18.815653 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '48fda564-aef1-4a00-81cb-ec4aaabae799', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '27614d4b-dae2-45dc-a35b-985ed2999cb3'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:24:18.815653 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c9b5432d-f467-408f-ab5e-7e2de5376dbe" -d '{"events": [{"server_uuid": "48fda564-aef1-4a00-81cb-ec4aaabae799", "name": "network-vif-plugged", "status": "completed", "tag": "27614d4b-dae2-45dc-a35b-985ed2999cb3"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:24:18.841085 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:24:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e7d7a3ad-9891-4397-9acc-b819da6e9e5f x-openstack-request-id: req-e7d7a3ad-9891-4397-9acc-b819da6e9e5f {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:24:18.841384 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "48fda564-aef1-4a00-81cb-ec4aaabae799", "name": "network-vif-plugged", "status": "completed", "tag": "27614d4b-dae2-45dc-a35b-985ed2999cb3", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:24:18.841636 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-e7d7a3ad-9891-4397-9acc-b819da6e9e5f {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:24:18.842028 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '48fda564-aef1-4a00-81cb-ec4aaabae799', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '27614d4b-dae2-45dc-a35b-985ed2999cb3', 'code': 200} Nov 24 11:24:18.950763 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:19.001743 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=27614d4b-dae2-45dc-a35b-985ed2999cb3,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:19.135389 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f08102d9-748b-4567-a48f-1a4d9f18cb5e req-fad48c7c-b8ad-4c4c-9463-b5a9debd61b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:19.142085 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-f08102d9-748b-4567-a48f-1a4d9f18cb5e req-fad48c7c-b8ad-4c4c-9463-b5a9debd61b9 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 1098 time: 0.0428231 Nov 24 11:24:19.189434 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-f08102d9-748b-4567-a48f-1a4d9f18cb5e req-0f82ccea-0783-43cc-9926-99a4eee79633 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441446 Nov 24 11:24:19.604536 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-29a6a9fd-6527-4520-9389-71d12a26f051 req-bb59e010-14bf-4928-80a9-5d69d9deaa66 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 210 time: 0.0260808 Nov 24 11:24:19.911399 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a20e11c-e818-435c-a2b7-e1837f8043f8 req-23fb8cc5-bb54-4a5c-a787-cb68e04456f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:19.912848 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9a20e11c-e818-435c-a2b7-e1837f8043f8 req-23fb8cc5-bb54-4a5c-a787-cb68e04456f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 945 time: 0.0477383 Nov 24 11:24:19.959703 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9a20e11c-e818-435c-a2b7-e1837f8043f8 req-2cdfed9a-9caf-45b1-9ebe-9929212876f2 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399070 Nov 24 11:24:20.707890 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-167fe563-ae88-4a38-bab7-60ca84972ea1 req-ab2c07c8-c027-44b7-9615-9bc068cd06af tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 210 time: 0.0260274 Nov 24 11:24:21.077385 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f85e1927-9ae6-499b-8904-1702b850c0e2 req-4db9da58-11e9-41e9-8d2b-b49b4114e15e tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:21.078831 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f85e1927-9ae6-499b-8904-1702b850c0e2 req-4db9da58-11e9-41e9-8d2b-b49b4114e15e tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 945 time: 0.0530295 Nov 24 11:24:21.126062 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f85e1927-9ae6-499b-8904-1702b850c0e2 req-e5b2dc36-2386-4ec9-9956-5f72d83b10ec tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414200 Nov 24 11:24:21.811592 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7e043dd2-72a2-4663-9c07-5a338ec7a07f req-588b89c5-411b-4f8b-b762-f0b48b897d14 tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "GET /v2.0/ports?device_id=19240268-0de5-4be0-9b3e-745da67e3b50 HTTP/1.1" status: 200 len: 210 time: 0.0260077 Nov 24 11:24:22.241900 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b4adf7d-2300-4500-a4a2-c2cb11a229fa req-132c148a-2caa-4e04-92c8-1a941bfbaadb tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:22.243391 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0b4adf7d-2300-4500-a4a2-c2cb11a229fa req-132c148a-2caa-4e04-92c8-1a941bfbaadb tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 945 time: 0.0485091 Nov 24 11:24:22.293023 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0b4adf7d-2300-4500-a4a2-c2cb11a229fa req-7ead9fef-abce-4ead-987a-f15c8cb8f0f3 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421538 Nov 24 11:24:22.571364 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 4309383c-b778-44aa-bd64-d0a29f77fb4d no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:24:22.592081 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 4309383c-b778-44aa-bd64-d0a29f77fb4d {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:24:22.592417 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 4309383c-b778-44aa-bd64-d0a29f77fb4d not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:24:22.872531 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34362) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:22.928288 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f9e98dd4-80ca-4f2f-8e00-827fb4f6b8bc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:22.956612 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f9e98dd4-80ca-4f2f-8e00-827fb4f6b8bc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:23.088047 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f9e98dd4-80ca-4f2f-8e00-827fb4f6b8bc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:23.091503 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-f9e98dd4-80ca-4f2f-8e00-827fb4f6b8bc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:23.092664 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-f9e98dd4-80ca-4f2f-8e00-827fb4f6b8bc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] 10.222.0.76 "DELETE /v2.0/security-groups/cfe5fa37-1c99-4d49-a45d-e098df726cee HTTP/1.1" status: 204 len: 168 time: 0.2191691 Nov 24 11:24:23.102112 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9e98dd4-80ca-4f2f-8e00-827fb4f6b8bc tempest-TestShelveInstance-686799163 tempest-TestShelveInstance-686799163-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=cfe5fa37-1c99-4d49-a45d-e098df726cee,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:23.220072 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34366) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:23.761000 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a4b62b-31b2-4453-9a02-1ce698a7f0b8 req-757bbe1a-9367-4432-a31b-ff15fd6bb446 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:23.762362 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a6a4b62b-31b2-4453-9a02-1ce698a7f0b8 req-757bbe1a-9367-4432-a31b-ff15fd6bb446 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 945 time: 0.1654620 Nov 24 11:24:23.801558 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da471e36-8a26-488f-ab69-2e2127d35720 req-4955cddf-9eb3-49c2-a6d2-c08ccd2ff653 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:23.802971 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-4955cddf-9eb3-49c2-a6d2-c08ccd2ff653 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/networks?id=256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d HTTP/1.1" status: 200 len: 814 time: 0.2047889 Nov 24 11:24:23.864576 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-d6655bbd-278c-4225-b551-e0bb1a5f7f18 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/quotas/f3594395ceb848e1bcdcf0fa1a6f78b4 HTTP/1.1" status: 200 len: 375 time: 0.0551646 Nov 24 11:24:23.913845 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a6a4b62b-31b2-4453-9a02-1ce698a7f0b8 req-b2e11bd9-6e39-4b97-a8f6-180894036089 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1447449 Nov 24 11:24:23.916108 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-ac8e2f85-8a15-41b4-b7d7-15d8eac37ac8 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=f3594395ceb848e1bcdcf0fa1a6f78b4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0423501 Nov 24 11:24:24.059473 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-0d5550d9-97e6-49a6-a4ac-e0b8a65b265c service neutron] 10.222.0.76 "GET /v2.0/networks/256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1227200 Nov 24 11:24:24.187324 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-83dbcc03-8e68-4bec-a564-4672ab2827c4 service neutron] 10.222.0.76 "GET /v2.0/networks/256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1217103 Nov 24 11:24:24.205250 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5cf9d346-7c45-49c4-875c-6758bd1a4066 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1009613'] for router_interface, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:24.468527 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a1a00b34-a9c8-4949-a7fa-4a9d71f09433 req-37438aed-8b47-45c0-9426-afdc515e9aeb tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 210 time: 0.0440102 Nov 24 11:24:24.493469 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-5cf9d346-7c45-49c4-875c-6758bd1a4066 admin admin] Deleting port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:24.493807 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5cf9d346-7c45-49c4-875c-6758bd1a4066 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:24.579559 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-5cf9d346-7c45-49c4-875c-6758bd1a4066 admin admin] For port f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:24.579860 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5cf9d346-7c45-49c4-875c-6758bd1a4066 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:24.593398 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-5cf9d346-7c45-49c4-875c-6758bd1a4066 admin admin] Calling delete_port for f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d owned by network:router_interface {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:24.887158 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5cf9d346-7c45-49c4-875c-6758bd1a4066 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:24.914098 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cf9d346-7c45-49c4-875c-6758bd1a4066 admin admin] Pushing event deleted for resources: {'Port': ['ID=f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:25.090081 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5cf9d346-7c45-49c4-875c-6758bd1a4066 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-637217', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1011037'] for router_interface, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:25.237448 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab56d8e2-03ed-491e-8c28-50c4072a5ef8 req-93340ebc-23eb-442d-bce7-8a7ce143cfe9 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:25.238913 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ab56d8e2-03ed-491e-8c28-50c4072a5ef8 req-93340ebc-23eb-442d-bce7-8a7ce143cfe9 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 945 time: 0.0995405 Nov 24 11:24:25.337210 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ab56d8e2-03ed-491e-8c28-50c4072a5ef8 req-8a8af340-36f6-4056-8ad3-b80ea44f387d tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0920475 Nov 24 11:24:25.394636 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5cf9d346-7c45-49c4-875c-6758bd1a4066 admin admin] Router 98c34a41-9cdb-48f6-bfa4-2ed94016563f has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:24:25.503637 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5cf9d346-7c45-49c4-875c-6758bd1a4066 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:24:25.509129 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-5cf9d346-7c45-49c4-875c-6758bd1a4066 admin admin] 10.222.0.76 "PUT /v2.0/routers/98c34a41-9cdb-48f6-bfa4-2ed94016563f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2880039 Nov 24 11:24:25.511684 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34414) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:25.514400 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb0c9b42-d877-43cb-8267-847347a778e5 None None] Sync routers for ids ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:24:25.524087 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb0c9b42-d877-43cb-8267-847347a778e5 None None] Routers {'98c34a41-9cdb-48f6-bfa4-2ed94016563f'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:24:25.525571 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-fb0c9b42-d877-43cb-8267-847347a778e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:24:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:25.594881 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ab8108c1-4af4-4479-b1e9-15c45d6360d6 req-bd45a7ca-ba45-4774-a3be-157ab5fcd017 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 210 time: 0.0372646 Nov 24 11:24:25.653251 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Publish callbacks [] for router, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:25.756768 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-fb0c9b42-d877-43cb-8267-847347a778e5 None None] Set router 98c34a41-9cdb-48f6-bfa4-2ed94016563f gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:24:25.762301 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:25.883464 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Deleting port b04704b9-716b-4043-b41c-569809c4e9ce {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:25.883844 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:25.937185 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-fb0c9b42-d877-43cb-8267-847347a778e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36'}], 'enable_snat': True}, 'gw_port_id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:24:24Z', 'revision_number': 5, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port': {'id': 'b04704b9-716b-4043-b41c-569809c4e9ce', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:4c:1d:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 447, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.36', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:19:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:25.962929 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb0c9b42-d877-43cb-8267-847347a778e5 None None] Checking router: 98c34a41-9cdb-48f6-bfa4-2ed94016563f for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:24:25.967606 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] For port b04704b9-716b-4043-b41c-569809c4e9ce, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=b04704b9-716b-4043-b41c-569809c4e9ce,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:25.968107 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:25.971282 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb0c9b42-d877-43cb-8267-847347a778e5 None None] Routers {'98c34a41-9cdb-48f6-bfa4-2ed94016563f'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:24:25.971903 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-fb0c9b42-d877-43cb-8267-847347a778e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:24:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:25.979848 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Calling delete_port for b04704b9-716b-4043-b41c-569809c4e9ce owned by network:router_gateway {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:26.057261 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-fb0c9b42-d877-43cb-8267-847347a778e5 None None] Set router 98c34a41-9cdb-48f6-bfa4-2ed94016563f gateway port host: None {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:24:26.109031 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-fb0c9b42-d877-43cb-8267-847347a778e5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:24:25Z', 'revision_number': 6, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port_host': None}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:26.138952 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb0c9b42-d877-43cb-8267-847347a778e5 None None] The sync data for ids ['98c34a41-9cdb-48f6-bfa4-2ed94016563f'] in dv-cinder-804035-18-iscsi is: [{'id': '98c34a41-9cdb-48f6-bfa4-2ed94016563f', 'name': 'tempest-TestShelveInstance-1685981445-router', 'tenant_id': '89e9b1abd4814b03ae8c95c5918bef03', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:22Z', 'updated_at': '2021-11-24T11:24:25Z', 'revision_number': 6, 'project_id': '89e9b1abd4814b03ae8c95c5918bef03', 'gw_port_host': None}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:24:26.218674 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:26.251815 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Pushing event deleted for resources: {'Port': ['ID=b04704b9-716b-4043-b41c-569809c4e9ce,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:26.309087 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-942710'] for router_gateway, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:26.439320 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1010955', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-663'] for router, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:26.453775 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:26.467085 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da471e36-8a26-488f-ab69-2e2127d35720 req-d5f4078c-18cc-4385-ae2b-de45bdd503c1 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:26.468606 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-d5f4078c-18cc-4385-ae2b-de45bdd503c1 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.86 "GET /v2.0/networks?id=256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d HTTP/1.1" status: 200 len: 814 time: 0.1101344 Nov 24 11:24:26.484581 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-da471e36-8a26-488f-ab69-2e2127d35720 req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Request body: {'port': {'device_id': '7dac7026-2f1f-46e6-a922-fa8b312b0d79', 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d', 'admin_state_up': True, 'tenant_id': 'f3594395ceb848e1bcdcf0fa1a6f78b4'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:24:26.527005 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd40c880-3721-481b-94ce-33e3df7047b1 req-896944b9-5c9f-4b11-b7da-9ec62e5323d8 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:26.528624 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd40c880-3721-481b-94ce-33e3df7047b1 req-896944b9-5c9f-4b11-b7da-9ec62e5323d8 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.86 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 945 time: 0.1310291 Nov 24 11:24:26.539727 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc29f41f-4035-42bf-bc86-933c88016932 req-7b594053-8e62-4969-a2b9-62cc8444c218 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:26.541218 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cc29f41f-4035-42bf-bc86-933c88016932 req-7b594053-8e62-4969-a2b9-62cc8444c218 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 945 time: 0.1319690 Nov 24 11:24:26.629150 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1010962'] for router, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:26.629767 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 98c34a41-9cdb-48f6-bfa4-2ed94016563f {{(pid=103244) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 11:24:26.641723 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] Publish callbacks [] for router, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:26.642916 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-96b6ebf5-2558-4fa0-9c1e-d0bd87d07b2b admin admin] 10.222.0.76 "DELETE /v2.0/routers/98c34a41-9cdb-48f6-bfa4-2ed94016563f HTTP/1.1" status: 204 len: 168 time: 1.1303146 Nov 24 11:24:26.645583 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 34420) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:26.658621 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cc29f41f-4035-42bf-bc86-933c88016932 req-bcf58a89-b8b2-4d3e-95bc-7f28f4f79522 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/security-groups?id=72521c9f-0ea2-40e1-9b1f-577c15c394f6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0897503 Nov 24 11:24:26.688813 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [req-bd40c880-3721-481b-94ce-33e3df7047b1 req-39b5ac4f-64b2-43b8-a298-31fdc5b77a31 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Deleting port 27614d4b-dae2-45dc-a35b-985ed2999cb3 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:26.689194 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-bd40c880-3721-481b-94ce-33e3df7047b1 req-39b5ac4f-64b2-43b8-a298-31fdc5b77a31 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:26.692239 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-da471e36-8a26-488f-ab69-2e2127d35720 req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Made reservation on behalf of f3594395ceb848e1bcdcf0fa1a6f78b4 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:24:26.695808 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-da471e36-8a26-488f-ab69-2e2127d35720 req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:26.706865 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-08b0c45e-5c18-49ba-b470-d1f9760255e9 req-fcdf8304-5efa-47fb-9677-7bd6ddf85db0 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 210 time: 0.0323827 Nov 24 11:24:26.724654 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_v2 [None req-31294a8b-bcca-409e-94c9-da3e7f477b94 admin admin] Deleting subnet 2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c {{(pid=103243) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:24:26.734210 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-31294a8b-bcca-409e-94c9-da3e7f477b94 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:26.801038 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [req-bd40c880-3721-481b-94ce-33e3df7047b1 req-39b5ac4f-64b2-43b8-a298-31fdc5b77a31 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] For port 27614d4b-dae2-45dc-a35b-985ed2999cb3, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=27614d4b-dae2-45dc-a35b-985ed2999cb3,segment=NetworkSegment(698e6ff0-3fe3-4914-b785-972d8f6cc124),segment_id=698e6ff0-3fe3-4914-b785-972d8f6cc124)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:26.801395 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-bd40c880-3721-481b-94ce-33e3df7047b1 req-39b5ac4f-64b2-43b8-a298-31fdc5b77a31 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:26.807562 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-31294a8b-bcca-409e-94c9-da3e7f477b94 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-9292937'] for subnet, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:26.815006 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [req-bd40c880-3721-481b-94ce-33e3df7047b1 req-39b5ac4f-64b2-43b8-a298-31fdc5b77a31 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Calling delete_port for 27614d4b-dae2-45dc-a35b-985ed2999cb3 owned by compute:nova {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:26.921180 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-da471e36-8a26-488f-ab69-2e2127d35720 req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Allocated IP 172.20.0.2 (256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d/4c8f23cd-59c3-43ba-a990-3dfaf32f8cf7/56307143-2621-48ea-ba9c-19d79fb25b11) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:24:26.948560 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-31294a8b-bcca-409e-94c9-da3e7f477b94 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.010283 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-bd40c880-3721-481b-94ce-33e3df7047b1 req-39b5ac4f-64b2-43b8-a298-31fdc5b77a31 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.024616 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['27614d4b-dae2-45dc-a35b-985ed2999cb3'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:24:27.043500 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b5ac4f-64b2-43b8-a298-31fdc5b77a31 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Pushing event deleted for resources: {'Port': ['ID=27614d4b-dae2-45dc-a35b-985ed2999cb3,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:27.082579 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [req-bd40c880-3721-481b-94ce-33e3df7047b1 req-39b5ac4f-64b2-43b8-a298-31fdc5b77a31 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] No DVR routers for this DVR port 27614d4b-dae2-45dc-a35b-985ed2999cb3 on host hv-cinder-80403 {{(pid=103244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:24:27.085024 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [req-bd40c880-3721-481b-94ce-33e3df7047b1 req-39b5ac4f-64b2-43b8-a298-31fdc5b77a31 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.088580 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-bd40c880-3721-481b-94ce-33e3df7047b1 req-39b5ac4f-64b2-43b8-a298-31fdc5b77a31 tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.86 "DELETE /v2.0/ports/27614d4b-dae2-45dc-a35b-985ed2999cb3 HTTP/1.1" status: 204 len: 173 time: 0.5464683 Nov 24 11:24:27.089027 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '48fda564-aef1-4a00-81cb-ec4aaabae799', 'name': 'network-vif-deleted', 'tag': '27614d4b-dae2-45dc-a35b-985ed2999cb3'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:24:27.091399 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b887bd60-8aed-41c8-ae65-a7c326d14b14" -d '{"events": [{"server_uuid": "48fda564-aef1-4a00-81cb-ec4aaabae799", "name": "network-vif-deleted", "tag": "27614d4b-dae2-45dc-a35b-985ed2999cb3"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:24:27.131045 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-31294a8b-bcca-409e-94c9-da3e7f477b94 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8721838', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9106635'] for subnet, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.132453 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:24:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-212f1e7b-cc14-43ba-92bd-a2eb9c218dc9 x-openstack-request-id: req-212f1e7b-cc14-43ba-92bd-a2eb9c218dc9 {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:24:27.132855 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "48fda564-aef1-4a00-81cb-ec4aaabae799", "name": "network-vif-deleted", "tag": "27614d4b-dae2-45dc-a35b-985ed2999cb3", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:24:27.133171 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-212f1e7b-cc14-43ba-92bd-a2eb9c218dc9 {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:24:27.133615 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '48fda564-aef1-4a00-81cb-ec4aaabae799', 'name': 'network-vif-deleted', 'tag': '27614d4b-dae2-45dc-a35b-985ed2999cb3', 'status': 'completed', 'code': 200} Nov 24 11:24:27.137399 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-da471e36-8a26-488f-ab69-2e2127d35720 req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.169709 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-31294a8b-bcca-409e-94c9-da3e7f477b94 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.174121 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-31294a8b-bcca-409e-94c9-da3e7f477b94 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c HTTP/1.1" status: 204 len: 168 time: 0.5272040 Nov 24 11:24:27.175492 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9304ed25-d2e9-45f1-9944-727238572fdf None None] Network 6b81a015-9685-4892-8d78-2a713f48dc53 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:24:27.176889 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31294a8b-bcca-409e-94c9-da3e7f477b94 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2d0dfba5-9692-4d5b-8e51-09cf8f5c9d4c,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:27.178944 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34428) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:27.267917 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.302429 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-da471e36-8a26-488f-ab69-2e2127d35720 req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.337350 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Deleting port 9e79b152-3919-43a2-90d9-08174e4707be {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:27.338159 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.369547 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-da471e36-8a26-488f-ab69-2e2127d35720 req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:24:27.373886 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-da471e36-8a26-488f-ab69-2e2127d35720 req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:24:27.379022 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-da471e36-8a26-488f-ab69-2e2127d35720 req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:24:27.382929 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Pushing event updated for resources: {'Port': ['ID=56307143-2621-48ea-ba9c-19d79fb25b11,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:27.417754 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ced57e2-8784-47f0-93db-64d8a7244865 None None] DHCP port deletion for 6b81a015-9685-4892-8d78-2a713f48dc53 request from dv-cinder-804035-18-iscsi {{(pid=103245) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 11:24:27.439323 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] For port 9e79b152-3919-43a2-90d9-08174e4707be, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9e79b152-3919-43a2-90d9-08174e4707be,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:27.439703 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.443887 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da471e36-8a26-488f-ab69-2e2127d35720 req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:27.444509 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-da471e36-8a26-488f-ab69-2e2127d35720 req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.449299 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device b04704b9-716b-4043-b41c-569809c4e9ce no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:24:27.455129 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Calling delete_port for 9e79b152-3919-43a2-90d9-08174e4707be owned by network:dhcp {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:27.475906 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: b04704b9-716b-4043-b41c-569809c4e9ce {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:24:27.476277 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device b04704b9-716b-4043-b41c-569809c4e9ce not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:24:27.476737 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:24:27.508349 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:24:27.508349 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device f6c1b7d9-adb2-45a1-8bc2-744bb1542f4d not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:24:27.520202 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-1ced57e2-8784-47f0-93db-64d8a7244865 None None] Deleting port 9e79b152-3919-43a2-90d9-08174e4707be {{(pid=103245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:27.520606 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-1ced57e2-8784-47f0-93db-64d8a7244865 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.555838 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-98e1e450-b519-44eb-8f25-9d18e0205aa9 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0775390 Nov 24 11:24:27.572079 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Request body: {'port': {'device_id': '7dac7026-2f1f-46e6-a922-fa8b312b0d79', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:24:27.589299 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-1ced57e2-8784-47f0-93db-64d8a7244865 None None] For port 9e79b152-3919-43a2-90d9-08174e4707be, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9e79b152-3919-43a2-90d9-08174e4707be,segment=NetworkSegment(8a5c6583-f0d2-4382-9e2b-b92e582459b2),segment_id=8a5c6583-f0d2-4382-9e2b-b92e582459b2)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:27.590015 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-1ced57e2-8784-47f0-93db-64d8a7244865 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.605054 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-1ced57e2-8784-47f0-93db-64d8a7244865 None None] Calling delete_port for 9e79b152-3919-43a2-90d9-08174e4707be owned by network:dhcp {{(pid=103245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:27.630907 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.750466 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-1ced57e2-8784-47f0-93db-64d8a7244865 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.763788 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ced57e2-8784-47f0-93db-64d8a7244865 None None] No DVR routers for this DVR port 9e79b152-3919-43a2-90d9-08174e4707be on host dv-cinder-804035-18-iscsi {{(pid=103245) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:24:27.806804 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ced57e2-8784-47f0-93db-64d8a7244865 None None] Pushing event deleted for resources: {'Port': ['ID=9e79b152-3919-43a2-90d9-08174e4707be,revision_number=None']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:27.822660 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-67ebf395-a114-4fc6-ba74-1b208cb42c5d req-11e66bf0-ddd8-4183-be6f-7a9239d4d6fb tempest-VolumesActionsTest-1062462626 tempest-VolumesActionsTest-1062462626-project] 10.222.0.76 "GET /v2.0/ports?device_id=48fda564-aef1-4a00-81cb-ec4aaabae799 HTTP/1.1" status: 200 len: 210 time: 0.0342453 Nov 24 11:24:27.895526 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe11273f-7609-48ea-bae5-e967b922e5f6 req-cbaeeb54-a4a6-4273-8db6-13554e669a0f tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:27.896927 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fe11273f-7609-48ea-bae5-e967b922e5f6 req-cbaeeb54-a4a6-4273-8db6-13554e669a0f tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 931 time: 0.0680747 Nov 24 11:24:27.922864 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.958215 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Pushing event deleted for resources: {'Port': ['ID=9e79b152-3919-43a2-90d9-08174e4707be,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:27.964814 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] No DVR routers for this DVR port 9e79b152-3919-43a2-90d9-08174e4707be on host dv-cinder-804035-18-iscsi {{(pid=103244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:24:27.977627 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 56307143-2621-48ea-ba9c-19d79fb25b11 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:24:27.986249 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:27.998350 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Transition to ACTIVE for port object 56307143-2621-48ea-ba9c-19d79fb25b11 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:24:28.032023 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fe11273f-7609-48ea-bae5-e967b922e5f6 req-2c6dbf24-b510-49a3-b49b-e5a7b7b25f82 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1282003 Nov 24 11:24:28.063402 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.083603 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6b81a015-9685-4892-8d78-2a713f48dc53']}} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:28.088959 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.093869 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8a5c6583-f0d2-4382-9e2b-b92e582459b2') {'for_net_delete': True} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:28.094157 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8a5c6583-f0d2-4382-9e2b-b92e582459b2') {} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:28.108368 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4161272'] for segment, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.121785 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.128409 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Releasing vlan 1239 on physical network physnet1 to pool {{(pid=103244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:24:28.128788 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8699699'] for segment, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: self.session.flush() Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: self.session.flush() Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: self.session.flush() Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: self.session.flush() Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: Traceback (most recent call last): Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: timer() Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: cb(*args, **kw) Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: return func(*args, **kwargs) Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: self._notify() Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: self.callback(batched_events) Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: event.method(event) Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: return f(self, *a, **k) Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._get(url).json() Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: return self.request(url, 'GET', **kwargs) Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:24:28.130465 dv-cinder-804035-18-iscsi neutron-server[103244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:24:28.137709 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Pushing event updated for resources: {'Port': ['ID=56307143-2621-48ea-ba9c-19d79fb25b11,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:28.206933 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Attempting to bind port 56307143-2621-48ea-ba9c-19d79fb25b11 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:24:28.207266 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Attempting to bind port 56307143-2621-48ea-ba9c-19d79fb25b11 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': 'd17edd0c-57ba-4458-9e65-d12987ea086d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1235, 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:24:28.207617 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Attempting to bind port 56307143-2621-48ea-ba9c-19d79fb25b11 on network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:24:28.212108 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Port 56307143-2621-48ea-ba9c-19d79fb25b11 on network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:24:28.212431 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Attempting to bind port 56307143-2621-48ea-ba9c-19d79fb25b11 on network 256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:24:28.218206 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 24, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:24:28.218538 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Checking segment: {'id': 'd17edd0c-57ba-4458-9e65-d12987ea086d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1235, 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:24:28.218916 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Bound using segment: {'id': 'd17edd0c-57ba-4458-9e65-d12987ea086d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1235, 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:24:28.219399 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Bound port: 56307143-2621-48ea-ba9c-19d79fb25b11, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd17edd0c-57ba-4458-9e65-d12987ea086d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1235, 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:24:28.219750 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.253014 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.257414 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.260715 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] 10.222.0.76 "DELETE /v2.0/networks/6b81a015-9685-4892-8d78-2a713f48dc53 HTTP/1.1" status: 204 len: 168 time: 1.0806623 Nov 24 11:24:28.264497 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34434) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:28.286662 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] For port 56307143-2621-48ea-ba9c-19d79fb25b11, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:24:28.289709 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] For port 56307143-2621-48ea-ba9c-19d79fb25b11, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=56307143-2621-48ea-ba9c-19d79fb25b11,segment=NetworkSegment(d17edd0c-57ba-4458-9e65-d12987ea086d),segment_id=d17edd0c-57ba-4458-9e65-d12987ea086d)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:24:28.313332 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c49cfcd5-7db2-4d83-89ae-d13e298095f4 admin admin] Pushing event deleted for resources: {'Network': ['ID=6b81a015-9685-4892-8d78-2a713f48dc53,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:28.450560 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.485051 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:28.485868 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.487549 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] 10.222.0.86 "PUT /v2.0/ports/56307143-2621-48ea-ba9c-19d79fb25b11 HTTP/1.1" status: 200 len: 1093 time: 0.9207909 Nov 24 11:24:28.489974 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7dac7026-2f1f-46e6-a922-fa8b312b0d79', 'tag': '56307143-2621-48ea-ba9c-19d79fb25b11'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:24:28.492877 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4be3fd12-f261-4d86-b292-be127219fe61" -d '{"events": [{"name": "network-changed", "server_uuid": "7dac7026-2f1f-46e6-a922-fa8b312b0d79", "tag": "56307143-2621-48ea-ba9c-19d79fb25b11"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:24:28.519752 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0c4f7bc-3e43-4a14-9dc8-7a928a6c8f69 service neutron] Pushing event updated for resources: {'Port': ['ID=56307143-2621-48ea-ba9c-19d79fb25b11,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:28.533515 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:24:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cb79d2e6-0a5f-4522-a4e6-380155d1aaf2 x-openstack-request-id: req-cb79d2e6-0a5f-4522-a4e6-380155d1aaf2 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:24:28.534037 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7dac7026-2f1f-46e6-a922-fa8b312b0d79", "tag": "56307143-2621-48ea-ba9c-19d79fb25b11", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:24:28.534403 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-cb79d2e6-0a5f-4522-a4e6-380155d1aaf2 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:24:28.534848 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7dac7026-2f1f-46e6-a922-fa8b312b0d79', 'tag': '56307143-2621-48ea-ba9c-19d79fb25b11', 'status': 'completed', 'code': 200} Nov 24 11:24:28.596993 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be3fd12-f261-4d86-b292-be127219fe61 req-11667a4c-fcbc-4c4e-8e8a-fc18b4a5c0f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:28.598530 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4be3fd12-f261-4d86-b292-be127219fe61 req-11667a4c-fcbc-4c4e-8e8a-fc18b4a5c0f1 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=f3594395ceb848e1bcdcf0fa1a6f78b4&device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 1096 time: 0.0411835 Nov 24 11:24:28.635778 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4eb17c8d-b996-4d55-b2c7-a7052970002b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1009613'] for router_interface, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.701760 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be3fd12-f261-4d86-b292-be127219fe61 req-6f9e50e7-6a4c-4524-b508-5cc668823a69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:28.703112 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4be3fd12-f261-4d86-b292-be127219fe61 req-6f9e50e7-6a4c-4524-b508-5cc668823a69 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=f3594395ceb848e1bcdcf0fa1a6f78b4&shared=False HTTP/1.1" status: 200 len: 916 time: 0.0959063 Nov 24 11:24:28.798041 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be3fd12-f261-4d86-b292-be127219fe61 req-2312dd69-c756-4397-9441-5397489b48ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:28.799596 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4be3fd12-f261-4d86-b292-be127219fe61 req-2312dd69-c756-4397-9441-5397489b48ee service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.0887945 Nov 24 11:24:28.879396 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da471e36-8a26-488f-ab69-2e2127d35720 req-906506f1-0ce6-4a34-80d5-eb19ea471303 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:28.881123 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-906506f1-0ce6-4a34-80d5-eb19ea471303 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=f3594395ceb848e1bcdcf0fa1a6f78b4&device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 1096 time: 0.0461869 Nov 24 11:24:28.899656 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-4eb17c8d-b996-4d55-b2c7-a7052970002b admin admin] Deleting port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:28.899998 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4eb17c8d-b996-4d55-b2c7-a7052970002b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.932422 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-4623e6d1-e629-42a8-af5f-f9c0761c0e34 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=56307143-2621-48ea-ba9c-19d79fb25b11 HTTP/1.1" status: 200 len: 217 time: 0.0418727 Nov 24 11:24:28.979006 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-4eb17c8d-b996-4d55-b2c7-a7052970002b admin admin] For port 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=9f63b074-7e84-49ff-88d1-d86f5c4cb5f1,segment=NetworkSegment(78c61401-1987-4f48-8774-c9e7053eb1b3),segment_id=78c61401-1987-4f48-8774-c9e7053eb1b3)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:28.979312 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4eb17c8d-b996-4d55-b2c7-a7052970002b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:28.981220 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da471e36-8a26-488f-ab69-2e2127d35720 req-d02ee59b-07fe-4204-a000-c5adf407ac63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:28.983313 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-d02ee59b-07fe-4204-a000-c5adf407ac63 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=4c8f23cd-59c3-43ba-a990-3dfaf32f8cf7 HTTP/1.1" status: 200 len: 854 time: 0.0437436 Nov 24 11:24:28.992376 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-4eb17c8d-b996-4d55-b2c7-a7052970002b admin admin] Calling delete_port for 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 owned by network:router_interface {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:29.017727 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-3475c042-4698-429c-90d1-22c0ab91b1c5 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0272868 Nov 24 11:24:29.121462 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-ddeb683c-2af8-4a95-8df1-1570b67f94dd service neutron] 10.222.0.86 "GET /v2.0/networks/256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0963666 Nov 24 11:24:29.221552 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-da471e36-8a26-488f-ab69-2e2127d35720 req-cb495d26-93ac-40e8-a908-3c96997aab17 service neutron] 10.222.0.86 "GET /v2.0/networks/256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0929244 Nov 24 11:24:29.223637 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1151c0a7-0c98-4578-80f6-04fc8d71cc3f req-d6cd4a45-0e48-4043-b66b-fc4a834b6c08 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:29.225130 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1151c0a7-0c98-4578-80f6-04fc8d71cc3f req-d6cd4a45-0e48-4043-b66b-fc4a834b6c08 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 943 time: 0.0909951 Nov 24 11:24:29.274539 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1151c0a7-0c98-4578-80f6-04fc8d71cc3f req-e113184b-2e85-4bcf-8c43-8950c0a0f356 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426643 Nov 24 11:24:29.305976 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4eb17c8d-b996-4d55-b2c7-a7052970002b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:29.330406 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eb17c8d-b996-4d55-b2c7-a7052970002b admin admin] Pushing event deleted for resources: {'Port': ['ID=9f63b074-7e84-49ff-88d1-d86f5c4cb5f1,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:29.364355 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9e79b152-3919-43a2-90d9-08174e4707be no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:24:29.385245 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 9e79b152-3919-43a2-90d9-08174e4707be {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:24:29.385967 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9e79b152-3919-43a2-90d9-08174e4707be not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:24:29.516471 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4eb17c8d-b996-4d55-b2c7-a7052970002b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-637217', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1011037'] for router_interface, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:29.737028 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4eb17c8d-b996-4d55-b2c7-a7052970002b admin admin] Router d7bfdd73-9632-4b35-849e-49f45e824a42 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:24:29.844016 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4eb17c8d-b996-4d55-b2c7-a7052970002b admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:24:29.849273 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-4eb17c8d-b996-4d55-b2c7-a7052970002b admin admin] 10.222.0.76 "PUT /v2.0/routers/d7bfdd73-9632-4b35-849e-49f45e824a42/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5838170 Nov 24 11:24:29.851899 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 34466) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:29.853096 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a4feffc-6f6f-4434-a39c-ca6f62a850c0 None None] Sync routers for ids ['d7bfdd73-9632-4b35-849e-49f45e824a42'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:24:29.865731 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a4feffc-6f6f-4434-a39c-ca6f62a850c0 None None] Routers {'d7bfdd73-9632-4b35-849e-49f45e824a42'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:24:29.866352 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-6a4feffc-6f6f-4434-a39c-ca6f62a850c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:24:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['d7bfdd73-9632-4b35-849e-49f45e824a42'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:29.959400 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Publish callbacks [] for router, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:29.975351 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-6a4feffc-6f6f-4434-a39c-ca6f62a850c0 None None] Set router d7bfdd73-9632-4b35-849e-49f45e824a42 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:24:30.062579 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:30.152296 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-6a4feffc-6f6f-4434-a39c-ca6f62a850c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'name': 'tempest-TestShelveInstance-1190328099-router', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85'}], 'enable_snat': True}, 'gw_port_id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:30Z', 'updated_at': '2021-11-24T11:24:29Z', 'revision_number': 5, 'project_id': '02eceba9328941719d32211c28e13ae0', 'gw_port': {'id': 'a21712de-345b-4141-9d84-af68ebe8dd08', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:2a:14:bc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 463, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:19:31Z', 'updated_at': '2021-11-24T11:19:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:30.218845 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Deleting port a21712de-345b-4141-9d84-af68ebe8dd08 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:30.219414 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:30.284188 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a4feffc-6f6f-4434-a39c-ca6f62a850c0 None None] Checking router: d7bfdd73-9632-4b35-849e-49f45e824a42 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:24:30.292868 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a4feffc-6f6f-4434-a39c-ca6f62a850c0 None None] Routers {'d7bfdd73-9632-4b35-849e-49f45e824a42'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:24:30.293401 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-6a4feffc-6f6f-4434-a39c-ca6f62a850c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:24:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['d7bfdd73-9632-4b35-849e-49f45e824a42'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:30.312251 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] For port a21712de-345b-4141-9d84-af68ebe8dd08, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a21712de-345b-4141-9d84-af68ebe8dd08,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:30.312557 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:30.325163 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Calling delete_port for a21712de-345b-4141-9d84-af68ebe8dd08 owned by network:router_gateway {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:30.386872 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-6a4feffc-6f6f-4434-a39c-ca6f62a850c0 None None] Set router d7bfdd73-9632-4b35-849e-49f45e824a42 gateway port host: None {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:24:30.396360 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4891023-817e-419d-8c4a-a84600dc45dd req-bb5c9327-b259-44cf-8efb-9394af7aa6cb tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:30.397856 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c4891023-817e-419d-8c4a-a84600dc45dd req-bb5c9327-b259-44cf-8efb-9394af7aa6cb tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 943 time: 0.0536292 Nov 24 11:24:30.440930 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-6a4feffc-6f6f-4434-a39c-ca6f62a850c0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'name': 'tempest-TestShelveInstance-1190328099-router', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:30Z', 'updated_at': '2021-11-24T11:24:30Z', 'revision_number': 6, 'project_id': '02eceba9328941719d32211c28e13ae0', 'gw_port_host': None}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:30.451027 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c4891023-817e-419d-8c4a-a84600dc45dd req-3921d402-c64c-4177-8330-6ec4450348a7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460181 Nov 24 11:24:30.469801 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a4feffc-6f6f-4434-a39c-ca6f62a850c0 None None] The sync data for ids ['d7bfdd73-9632-4b35-849e-49f45e824a42'] in dv-cinder-804035-18-iscsi is: [{'id': 'd7bfdd73-9632-4b35-849e-49f45e824a42', 'name': 'tempest-TestShelveInstance-1190328099-router', 'tenant_id': '02eceba9328941719d32211c28e13ae0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:19:30Z', 'updated_at': '2021-11-24T11:24:30Z', 'revision_number': 6, 'project_id': '02eceba9328941719d32211c28e13ae0', 'gw_port_host': None}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:24:30.581488 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:30.608777 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Pushing event deleted for resources: {'Port': ['ID=a21712de-345b-4141-9d84-af68ebe8dd08,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:30.665635 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-942710'] for router_gateway, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:30.755211 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1010955', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-663'] for router, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:30.757241 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:30.856155 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1010962'] for router, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:30.856745 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d7bfdd73-9632-4b35-849e-49f45e824a42 {{(pid=103243) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 11:24:30.863871 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] Publish callbacks [] for router, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:30.865012 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-29867a74-b6e6-4e40-b799-bd8b14054c69 admin admin] 10.222.0.76 "DELETE /v2.0/routers/d7bfdd73-9632-4b35-849e-49f45e824a42 HTTP/1.1" status: 204 len: 168 time: 1.0121160 Nov 24 11:24:30.867495 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 34488) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:30.912071 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_v2 [None req-1f83e14e-8a32-43f8-b4dd-b4dd1684d1e0 admin admin] Deleting subnet 8be715fb-14e8-4c72-8f81-409bf0cdaa60 {{(pid=103243) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:24:30.915099 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1f83e14e-8a32-43f8-b4dd-b4dd1684d1e0 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:30.948635 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1f83e14e-8a32-43f8-b4dd-b4dd1684d1e0 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-9292937'] for subnet, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.025574 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1f83e14e-8a32-43f8-b4dd-b4dd1684d1e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.139681 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1f83e14e-8a32-43f8-b4dd-b4dd1684d1e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8721838', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9106635'] for subnet, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.164451 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f83e14e-8a32-43f8-b4dd-b4dd1684d1e0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8be715fb-14e8-4c72-8f81-409bf0cdaa60,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:31.168058 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1f83e14e-8a32-43f8-b4dd-b4dd1684d1e0 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.173784 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-1f83e14e-8a32-43f8-b4dd-b4dd1684d1e0 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/8be715fb-14e8-4c72-8f81-409bf0cdaa60 HTTP/1.1" status: 204 len: 168 time: 0.3052948 Nov 24 11:24:31.174892 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f179faca-f799-47eb-aecd-a5d23aec3c56 None None] Network 73fc50e3-6c8b-4fe1-bb1e-2972356190e5 requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:24:31.175608 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 34490) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:31.380970 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11eebb2c-6492-4ef3-a9b7-ac4d943f6640 None None] DHCP port deletion for 73fc50e3-6c8b-4fe1-bb1e-2972356190e5 request from dv-cinder-804035-18-iscsi {{(pid=103245) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 11:24:31.408073 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a21712de-345b-4141-9d84-af68ebe8dd08 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:24:31.435655 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: a21712de-345b-4141-9d84-af68ebe8dd08 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:24:31.436212 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a21712de-345b-4141-9d84-af68ebe8dd08 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:24:31.436625 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:24:31.460666 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:24:31.466825 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 9f63b074-7e84-49ff-88d1-d86f5c4cb5f1 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:24:31.485744 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-11eebb2c-6492-4ef3-a9b7-ac4d943f6640 None None] Deleting port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 {{(pid=103245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:31.486255 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-11eebb2c-6492-4ef3-a9b7-ac4d943f6640 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.561964 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-11eebb2c-6492-4ef3-a9b7-ac4d943f6640 None None] For port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65,segment=NetworkSegment(78c61401-1987-4f48-8774-c9e7053eb1b3),segment_id=78c61401-1987-4f48-8774-c9e7053eb1b3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:31.562353 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-11eebb2c-6492-4ef3-a9b7-ac4d943f6640 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.566945 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.579824 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-11eebb2c-6492-4ef3-a9b7-ac4d943f6640 None None] Calling delete_port for a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 owned by network:dhcp {{(pid=103245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:31.625684 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Deleting port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:24:31.626141 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.694408 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] For port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65,segment=NetworkSegment(78c61401-1987-4f48-8774-c9e7053eb1b3),segment_id=78c61401-1987-4f48-8774-c9e7053eb1b3)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:31.694812 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.709833 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Calling delete_port for a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 owned by network:dhcp {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:24:31.719052 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-11eebb2c-6492-4ef3-a9b7-ac4d943f6640 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.739817 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e9e1b0-613d-4be4-b75a-459c0060894f req-31b52d6b-1676-48d0-a7c7-7250edea0de8 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:31.741464 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a7e9e1b0-613d-4be4-b75a-459c0060894f req-31b52d6b-1676-48d0-a7c7-7250edea0de8 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 943 time: 0.0544305 Nov 24 11:24:31.746113 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11eebb2c-6492-4ef3-a9b7-ac4d943f6640 None None] Pushing event deleted for resources: {'Port': ['ID=a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65,revision_number=None']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:31.749031 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11eebb2c-6492-4ef3-a9b7-ac4d943f6640 None None] No DVR routers for this DVR port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 on host dv-cinder-804035-18-iscsi {{(pid=103245) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:24:31.798882 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.802903 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a7e9e1b0-613d-4be4-b75a-459c0060894f req-ca2bf1ff-9dbe-4cbd-96e7-cbb9e246df2a tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480084 Nov 24 11:24:31.824262 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Pushing event deleted for resources: {'Port': ['ID=a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:31.827847 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] No DVR routers for this DVR port a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 on host dv-cinder-804035-18-iscsi {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:24:31.899427 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.920349 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['73fc50e3-6c8b-4fe1-bb1e-2972356190e5']}} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:31.929317 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '78c61401-1987-4f48-8774-c9e7053eb1b3') {'for_net_delete': True} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:31.929609 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '78c61401-1987-4f48-8774-c9e7053eb1b3') {} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:31.938613 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-9292944'] for segment, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.951622 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.957331 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Releasing vlan 1212 on physical network physnet1 to pool {{(pid=103243) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:24:31.957706 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8721920'] for segment, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: self.session.flush() Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: self.session.flush() Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: self.session.flush() Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py:676: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: self.session.flush() Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: Traceback (most recent call last): Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: timer() Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: cb(*args, **kw) Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: return func(*args, **kwargs) Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: self._notify() Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: self.callback(batched_events) Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: event.method(event) Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: return f(self, *a, **k) Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._get(url).json() Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: return self.request(url, 'GET', **kwargs) Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:24:31.959363 dv-cinder-804035-18-iscsi neutron-server[103243]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:24:32.084345 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:32.089605 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:32.093582 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] 10.222.0.76 "DELETE /v2.0/networks/73fc50e3-6c8b-4fe1-bb1e-2972356190e5 HTTP/1.1" status: 204 len: 168 time: 0.9169888 Nov 24 11:24:32.103946 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4da873e8-339e-4b17-ad7d-f7435fbd75d3 admin admin] Pushing event deleted for resources: {'Network': ['ID=73fc50e3-6c8b-4fe1-bb1e-2972356190e5,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:32.321551 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 27614d4b-dae2-45dc-a35b-985ed2999cb3 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:24:32.342742 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 27614d4b-dae2-45dc-a35b-985ed2999cb3 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:24:32.343062 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 27614d4b-dae2-45dc-a35b-985ed2999cb3 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:24:32.455850 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34504) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:32.493776 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-a15732e4-b8df-4598-b99f-6b55948a9b03 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=89e9b1abd4814b03ae8c95c5918bef03&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0367892 Nov 24 11:24:32.496286 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34506) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:32.543741 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7522eb52-c890-4536-aceb-0b8e6b00b9cb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:32.571846 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7522eb52-c890-4536-aceb-0b8e6b00b9cb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:32.713137 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7522eb52-c890-4536-aceb-0b8e6b00b9cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:32.715780 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7522eb52-c890-4536-aceb-0b8e6b00b9cb admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:32.717069 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-7522eb52-c890-4536-aceb-0b8e6b00b9cb admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/6769c3c7-2437-42b9-b37d-db7211ed255c HTTP/1.1" status: 204 len: 168 time: 0.2198467 Nov 24 11:24:32.725050 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7522eb52-c890-4536-aceb-0b8e6b00b9cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6769c3c7-2437-42b9-b37d-db7211ed255c,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:32.920045 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1ebf145-6437-470d-8d66-8ef68cd8715b req-f0ca55e2-32ee-411c-932d-03c2d1e085d7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:32.921599 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a1ebf145-6437-470d-8d66-8ef68cd8715b req-f0ca55e2-32ee-411c-932d-03c2d1e085d7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 943 time: 0.0526087 Nov 24 11:24:32.969029 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a1ebf145-6437-470d-8d66-8ef68cd8715b req-e2e8b1ed-7378-451a-a494-ca0f2bba6443 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414481 Nov 24 11:24:33.301899 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 56307143-2621-48ea-ba9c-19d79fb25b11 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:24:33.377748 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:24:33.402679 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:24:33.403022 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device a4c05f0c-8db2-4f0d-be6f-95b3e1d41c65 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:24:33.425893 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 56307143-2621-48ea-ba9c-19d79fb25b11, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=56307143-2621-48ea-ba9c-19d79fb25b11,segment=NetworkSegment(d17edd0c-57ba-4458-9e65-d12987ea086d),segment_id=d17edd0c-57ba-4458-9e65-d12987ea086d)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:33.436380 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34518) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:33.438090 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '56307143-2621-48ea-ba9c-19d79fb25b11', 'network_id': '256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d', 'port_id': '56307143-2621-48ea-ba9c-19d79fb25b11', 'mac_address': 'fa:16:3e:a5:26:e4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1235, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4c8f23cd-59c3-43ba-a990-3dfaf32f8cf7', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:24:33.475466 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-64f6fc10-510f-4ae6-8496-e1a50a8165ad admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=02eceba9328941719d32211c28e13ae0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0377984 Nov 24 11:24:33.477841 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34520) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:33.480482 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:33.494118 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 56307143-2621-48ea-ba9c-19d79fb25b11 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:24:33.515332 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 56307143-2621-48ea-ba9c-19d79fb25b11, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=56307143-2621-48ea-ba9c-19d79fb25b11,segment=NetworkSegment(d17edd0c-57ba-4458-9e65-d12987ea086d),segment_id=d17edd0c-57ba-4458-9e65-d12987ea086d)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:33.525969 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-90c2a90b-3739-4779-9c67-ef31b7cc701e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:33.547058 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-90c2a90b-3739-4779-9c67-ef31b7cc701e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:33.595562 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:33.642422 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=56307143-2621-48ea-ba9c-19d79fb25b11,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:33.675598 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-90c2a90b-3739-4779-9c67-ef31b7cc701e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:33.678200 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-90c2a90b-3739-4779-9c67-ef31b7cc701e admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:33.679352 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-90c2a90b-3739-4779-9c67-ef31b7cc701e admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/3449a59b-8f0b-4c2f-8cef-72954554a796 HTTP/1.1" status: 204 len: 168 time: 0.2006166 Nov 24 11:24:33.688619 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90c2a90b-3739-4779-9c67-ef31b7cc701e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3449a59b-8f0b-4c2f-8cef-72954554a796,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:33.796775 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['56307143-2621-48ea-ba9c-19d79fb25b11'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:24:34.124039 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d3d2e5f-a986-4bfb-8c79-30bd93f8cc0b req-4c708ee5-9dc8-449b-9884-3c19f6a7af58 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:34.132371 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6d3d2e5f-a986-4bfb-8c79-30bd93f8cc0b req-4c708ee5-9dc8-449b-9884-3c19f6a7af58 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 944 time: 0.0715175 Nov 24 11:24:34.188440 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6d3d2e5f-a986-4bfb-8c79-30bd93f8cc0b req-09b64dfa-2af7-4e89-a468-02a9a2a206cf tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546331 Nov 24 11:24:35.311774 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8107104a-12fb-401b-b10b-301fdc635b90 req-4f81e374-811c-4402-9d37-fd0adc84abce tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:35.313454 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8107104a-12fb-401b-b10b-301fdc635b90 req-4f81e374-811c-4402-9d37-fd0adc84abce tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 944 time: 0.0542090 Nov 24 11:24:35.315357 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 56307143-2621-48ea-ba9c-19d79fb25b11 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:24:35.373477 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8107104a-12fb-401b-b10b-301fdc635b90 req-800e13d4-661c-4a74-828d-2e3a6e80e228 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512269 Nov 24 11:24:35.450217 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 56307143-2621-48ea-ba9c-19d79fb25b11 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:24:35.454340 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 56307143-2621-48ea-ba9c-19d79fb25b11 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:24:35.454716 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:35.542409 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:35.566553 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7dac7026-2f1f-46e6-a922-fa8b312b0d79', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '56307143-2621-48ea-ba9c-19d79fb25b11'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:24:35.568850 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0a4c4deb-a259-450e-9832-25840c311afa" -d '{"events": [{"server_uuid": "7dac7026-2f1f-46e6-a922-fa8b312b0d79", "name": "network-vif-plugged", "status": "completed", "tag": "56307143-2621-48ea-ba9c-19d79fb25b11"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:24:35.585589 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 56307143-2621-48ea-ba9c-19d79fb25b11, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=56307143-2621-48ea-ba9c-19d79fb25b11,segment=NetworkSegment(d17edd0c-57ba-4458-9e65-d12987ea086d),segment_id=d17edd0c-57ba-4458-9e65-d12987ea086d)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:24:35.620327 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:24:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dff35d75-222a-4ccb-b7fe-46de71cc1e1f x-openstack-request-id: req-dff35d75-222a-4ccb-b7fe-46de71cc1e1f {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:24:35.620622 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7dac7026-2f1f-46e6-a922-fa8b312b0d79", "name": "network-vif-plugged", "status": "completed", "tag": "56307143-2621-48ea-ba9c-19d79fb25b11", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:24:35.621048 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-dff35d75-222a-4ccb-b7fe-46de71cc1e1f {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:24:35.621264 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7dac7026-2f1f-46e6-a922-fa8b312b0d79', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '56307143-2621-48ea-ba9c-19d79fb25b11', 'code': 200} Nov 24 11:24:35.656006 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:35.728510 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=56307143-2621-48ea-ba9c-19d79fb25b11,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:35.942910 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37572eb0-79b8-424f-8049-b1fe1062117b req-2a49ef0d-9658-49d6-92be-8a34d310c5fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:35.944430 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-37572eb0-79b8-424f-8049-b1fe1062117b req-2a49ef0d-9658-49d6-92be-8a34d310c5fd service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 1098 time: 0.0521486 Nov 24 11:24:35.994119 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-37572eb0-79b8-424f-8049-b1fe1062117b req-b73fb443-0c43-4ae2-9ad7-23c3651ba2bc service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420501 Nov 24 11:24:36.511932 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ec9aba-b892-4133-a3ea-fc40ca9d4ed4 req-a7866394-3925-480b-b6cc-14d0c88e198e tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:36.514414 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-06ec9aba-b892-4133-a3ea-fc40ca9d4ed4 req-a7866394-3925-480b-b6cc-14d0c88e198e tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 945 time: 0.0553479 Nov 24 11:24:36.569564 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-06ec9aba-b892-4133-a3ea-fc40ca9d4ed4 req-751a653a-fe4a-4e02-b915-b8fe9444d5ea tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488853 Nov 24 11:24:37.714170 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b20e515-3023-4960-9561-fd7eb64900b0 req-5a8ee2dc-8ca9-42de-9595-b5d5d6763a24 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:24:37.715657 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9b20e515-3023-4960-9561-fd7eb64900b0 req-5a8ee2dc-8ca9-42de-9595-b5d5d6763a24 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 945 time: 0.0568297 Nov 24 11:24:37.765632 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9b20e515-3023-4960-9561-fd7eb64900b0 req-b2659836-cb67-4208-87af-2c507b789525 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433757 Nov 24 11:24:38.751693 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-38cc3459-1279-424e-9ba6-59b8f452c989 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:39.296698 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:41.182301 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-2dc0b4c6-1ecd-4c41-a894-2301c969cdb8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:42.492909 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:44.058405 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:44.821537 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:50.068122 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:24:55.543394 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34766) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:55.587515 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_v2 [None req-51c2eeec-dc10-4176-871f-f4044ceffe99 admin admin] Deleting subnet 458596b0-9c4c-4b58-86f1-e732479ac853 {{(pid=103244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:24:55.590504 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-51c2eeec-dc10-4176-871f-f4044ceffe99 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:55.628509 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-51c2eeec-dc10-4176-871f-f4044ceffe99 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4161249'] for subnet, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:55.666786 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-51c2eeec-dc10-4176-871f-f4044ceffe99 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:55.801712 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-51c2eeec-dc10-4176-871f-f4044ceffe99 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8699037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8480512'] for subnet, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:55.825675 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51c2eeec-dc10-4176-871f-f4044ceffe99 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=458596b0-9c4c-4b58-86f1-e732479ac853,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:55.831466 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-51c2eeec-dc10-4176-871f-f4044ceffe99 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:55.834686 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-51c2eeec-dc10-4176-871f-f4044ceffe99 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/458596b0-9c4c-4b58-86f1-e732479ac853 HTTP/1.1" status: 204 len: 168 time: 0.2894776 Nov 24 11:24:55.837396 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34768) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:55.907939 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:55.982777 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:56.001962 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c3773775-201b-4142-b6ec-b6fb9be9b452']}} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:56.010768 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '698e6ff0-3fe3-4914-b785-972d8f6cc124') {'for_net_delete': True} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:56.011054 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '698e6ff0-3fe3-4914-b785-972d8f6cc124') {} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:24:56.020691 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4161272'] for segment, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:56.033783 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:56.039602 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] Releasing vlan 1217 on physical network physnet1 to pool {{(pid=103244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:24:56.039915 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8699699'] for segment, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: Traceback (most recent call last): Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: timer() Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: cb(*args, **kw) Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: return func(*args, **kwargs) Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: self._notify() Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: self.callback(batched_events) Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: event.method(event) Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: return f(self, *a, **k) Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._get(url).json() Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: return self.request(url, 'GET', **kwargs) Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:24:56.041496 dv-cinder-804035-18-iscsi neutron-server[103244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:24:56.152570 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:56.158351 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:56.161488 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] 10.222.0.76 "DELETE /v2.0/networks/c3773775-201b-4142-b6ec-b6fb9be9b452 HTTP/1.1" status: 204 len: 168 time: 0.3231776 Nov 24 11:24:56.171777 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-479d5d32-dfc4-4292-8ff5-5f9100d1e36f admin admin] Pushing event deleted for resources: {'Network': ['ID=c3773775-201b-4142-b6ec-b6fb9be9b452,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:24:56.562560 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34778) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:56.601779 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-f146f0f1-f55d-44e8-9722-cf7ea8fd2119 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=603b0bf1aabf49efb7ac8be965b64567&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0380578 Nov 24 11:24:56.604161 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34780) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:24:56.656714 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8626763b-85ce-4bad-bd7b-0d3dc912e03d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:56.672973 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8626763b-85ce-4bad-bd7b-0d3dc912e03d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:56.821326 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8626763b-85ce-4bad-bd7b-0d3dc912e03d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:56.823923 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-8626763b-85ce-4bad-bd7b-0d3dc912e03d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:24:56.825061 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-8626763b-85ce-4bad-bd7b-0d3dc912e03d admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/72521c9f-0ea2-40e1-9b1f-577c15c394f6 HTTP/1.1" status: 204 len: 168 time: 0.2200384 Nov 24 11:24:56.833201 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8626763b-85ce-4bad-bd7b-0d3dc912e03d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=72521c9f-0ea2-40e1-9b1f-577c15c394f6,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:00.776106 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2944dd32-b882-4e3d-877e-06cf0ad3745c req-6a866f9a-ce3a-4f77-bf7c-bcc9ddf0209e tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:25:00.776106 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2944dd32-b882-4e3d-877e-06cf0ad3745c req-6a866f9a-ce3a-4f77-bf7c-bcc9ddf0209e tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 945 time: 0.2034652 Nov 24 11:25:00.820793 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2944dd32-b882-4e3d-877e-06cf0ad3745c req-5a31cceb-4f62-4fcc-9231-137bc15e906f tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419905 Nov 24 11:25:01.584092 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 34848) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:01.689292 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-77248e01-f10c-49c6-ac5e-df9f007e5792 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:01.762661 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-77248e01-f10c-49c6-ac5e-df9f007e5792 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:01.832416 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-77248e01-f10c-49c6-ac5e-df9f007e5792 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:01.871463 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77248e01-f10c-49c6-ac5e-df9f007e5792 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88da63e1-5c92-4d79-ab78-f6175b6ca1f8,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:01.880633 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-77248e01-f10c-49c6-ac5e-df9f007e5792 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=8cf76bcaa0754ddb896d86487484f7ee&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2954812 Nov 24 11:25:01.881497 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 34854) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:01.937600 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7bbce8c0-3e05-46c6-9b9f-3d5258bcffa0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:01.957996 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7bbce8c0-3e05-46c6-9b9f-3d5258bcffa0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:02.056387 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-266a7687-f79a-47b6-8240-8b2abaad43eb req-af16e293-02b6-4951-873c-c53fcebcc0f8 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:25:02.057828 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-266a7687-f79a-47b6-8240-8b2abaad43eb req-af16e293-02b6-4951-873c-c53fcebcc0f8 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 945 time: 0.1625857 Nov 24 11:25:02.058545 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7bbce8c0-3e05-46c6-9b9f-3d5258bcffa0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:02.061507 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-7bbce8c0-3e05-46c6-9b9f-3d5258bcffa0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:02.063150 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-7bbce8c0-3e05-46c6-9b9f-3d5258bcffa0 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/88da63e1-5c92-4d79-ab78-f6175b6ca1f8 HTTP/1.1" status: 204 len: 168 time: 0.1806917 Nov 24 11:25:02.089412 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bbce8c0-3e05-46c6-9b9f-3d5258bcffa0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88da63e1-5c92-4d79-ab78-f6175b6ca1f8,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:02.133021 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-266a7687-f79a-47b6-8240-8b2abaad43eb req-a073b68e-4185-44ad-ade3-4212290fcad4 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/security-groups?id=732f4c54-3fb7-459d-86f5-6a9c38558de9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631249 Nov 24 11:25:02.235162 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b70ff8d7-f624-49a8-99ef-6cbc44e2bb9c req-c2dfe921-1aa2-4259-9326-1439ee059969 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:25:02.236680 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-b70ff8d7-f624-49a8-99ef-6cbc44e2bb9c req-c2dfe921-1aa2-4259-9326-1439ee059969 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.86 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 945 time: 0.0492229 Nov 24 11:25:02.330936 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-b70ff8d7-f624-49a8-99ef-6cbc44e2bb9c req-e36ea031-0079-46f0-b31b-b28b2ed914e7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Deleting port 56307143-2621-48ea-ba9c-19d79fb25b11 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:25:02.331275 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-b70ff8d7-f624-49a8-99ef-6cbc44e2bb9c req-e36ea031-0079-46f0-b31b-b28b2ed914e7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:02.423191 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-b70ff8d7-f624-49a8-99ef-6cbc44e2bb9c req-e36ea031-0079-46f0-b31b-b28b2ed914e7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] For port 56307143-2621-48ea-ba9c-19d79fb25b11, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=56307143-2621-48ea-ba9c-19d79fb25b11,segment=NetworkSegment(d17edd0c-57ba-4458-9e65-d12987ea086d),segment_id=d17edd0c-57ba-4458-9e65-d12987ea086d)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:25:02.423595 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-b70ff8d7-f624-49a8-99ef-6cbc44e2bb9c req-e36ea031-0079-46f0-b31b-b28b2ed914e7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:02.435593 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-b70ff8d7-f624-49a8-99ef-6cbc44e2bb9c req-e36ea031-0079-46f0-b31b-b28b2ed914e7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Calling delete_port for 56307143-2621-48ea-ba9c-19d79fb25b11 owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:25:02.639085 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-b70ff8d7-f624-49a8-99ef-6cbc44e2bb9c req-e36ea031-0079-46f0-b31b-b28b2ed914e7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:02.651224 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['56307143-2621-48ea-ba9c-19d79fb25b11'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:25:02.680913 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e36ea031-0079-46f0-b31b-b28b2ed914e7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Pushing event deleted for resources: {'Port': ['ID=56307143-2621-48ea-ba9c-19d79fb25b11,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:02.714454 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-b70ff8d7-f624-49a8-99ef-6cbc44e2bb9c req-e36ea031-0079-46f0-b31b-b28b2ed914e7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] No DVR routers for this DVR port 56307143-2621-48ea-ba9c-19d79fb25b11 on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:25:02.717998 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-b70ff8d7-f624-49a8-99ef-6cbc44e2bb9c req-e36ea031-0079-46f0-b31b-b28b2ed914e7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:02.721639 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-b70ff8d7-f624-49a8-99ef-6cbc44e2bb9c req-e36ea031-0079-46f0-b31b-b28b2ed914e7 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.86 "DELETE /v2.0/ports/56307143-2621-48ea-ba9c-19d79fb25b11 HTTP/1.1" status: 204 len: 173 time: 0.4787555 Nov 24 11:25:02.722031 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7dac7026-2f1f-46e6-a922-fa8b312b0d79', 'name': 'network-vif-deleted', 'tag': '56307143-2621-48ea-ba9c-19d79fb25b11'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:25:02.724849 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e8bd820d-611a-4ff4-904d-88b0dbd4f062" -d '{"events": [{"server_uuid": "7dac7026-2f1f-46e6-a922-fa8b312b0d79", "name": "network-vif-deleted", "tag": "56307143-2621-48ea-ba9c-19d79fb25b11"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:25:02.760566 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:25:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32675250-91ac-4f1d-b60f-d734867bbe96 x-openstack-request-id: req-32675250-91ac-4f1d-b60f-d734867bbe96 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:25:02.760860 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7dac7026-2f1f-46e6-a922-fa8b312b0d79", "name": "network-vif-deleted", "tag": "56307143-2621-48ea-ba9c-19d79fb25b11", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:25:02.761140 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-32675250-91ac-4f1d-b60f-d734867bbe96 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:25:02.761727 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7dac7026-2f1f-46e6-a922-fa8b312b0d79', 'name': 'network-vif-deleted', 'tag': '56307143-2621-48ea-ba9c-19d79fb25b11', 'status': 'completed', 'code': 200} Nov 24 11:25:03.241323 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b278f946-1b22-45ef-9c6f-0e756852f6ac req-bdc418a0-88dd-4367-90ee-3755009e74b1 tempest-VolumesSnapshotTestJSON-859560417 tempest-VolumesSnapshotTestJSON-859560417-project] 10.222.0.76 "GET /v2.0/ports?device_id=7dac7026-2f1f-46e6-a922-fa8b312b0d79 HTTP/1.1" status: 200 len: 210 time: 0.0270195 Nov 24 11:25:05.440243 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 56307143-2621-48ea-ba9c-19d79fb25b11 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:25:05.459905 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 56307143-2621-48ea-ba9c-19d79fb25b11 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:25:05.460252 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 56307143-2621-48ea-ba9c-19d79fb25b11 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:25:08.726667 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0b415600-038a-4d3a-b557-82fa34e18b99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:09.237922 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:11.180529 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fa48f5cd-f186-4f89-84ef-bd5491b6bbff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:12.475279 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:14.060851 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:14.806928 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:27.067696 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:25:27.285637 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35078) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:27.388980 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:27.462517 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:27.538082 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:27.575735 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ad05c4a-223a-4628-8989-e0870ce0eaac,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:27.580185 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=cd319c58a786460593029f84e0bd7b20&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2935019 Nov 24 11:25:27.583081 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35088) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:27.584910 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.585260 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.585596 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.586202 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.586328 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.586561 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.586886 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.587501 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.587898 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.588134 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.588453 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.588906 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f25776c6-7dc3-4de1-b3fa-4cdcfc31328d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.633326 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:27.653563 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:27.775401 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:27.778071 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:27.779201 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/1ad05c4a-223a-4628-8989-e0870ce0eaac HTTP/1.1" status: 204 len: 168 time: 0.1948335 Nov 24 11:25:27.788122 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ad05c4a-223a-4628-8989-e0870ce0eaac,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:27.795334 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.795682 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.796015 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.796343 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.796761 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.797013 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.797328 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.797655 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.797987 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.798285 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.798594 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:27.798905 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76958998-d74a-4751-8d43-880755fadfdf admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:38.174600 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35220) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:38.282629 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d428d3e6-2067-449f-a2cf-2e42268ec77a admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:38.360188 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d428d3e6-2067-449f-a2cf-2e42268ec77a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:38.455689 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-d428d3e6-2067-449f-a2cf-2e42268ec77a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:38.494893 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-d428d3e6-2067-449f-a2cf-2e42268ec77a admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=a1baa23366bf488a98569bf20e3324c2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3190227 Nov 24 11:25:38.496804 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d428d3e6-2067-449f-a2cf-2e42268ec77a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e7f28e13-c859-43e6-abdb-8cf29e0681a5,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:38.497774 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35226) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:38.547564 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c64a582c-0f49-459b-b2d0-2338d5e1e498 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:38.572596 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c64a582c-0f49-459b-b2d0-2338d5e1e498 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:38.692788 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c64a582c-0f49-459b-b2d0-2338d5e1e498 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:38.696122 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-c64a582c-0f49-459b-b2d0-2338d5e1e498 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:38.697324 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-c64a582c-0f49-459b-b2d0-2338d5e1e498 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/e7f28e13-c859-43e6-abdb-8cf29e0681a5 HTTP/1.1" status: 204 len: 168 time: 0.1985061 Nov 24 11:25:38.705552 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c64a582c-0f49-459b-b2d0-2338d5e1e498 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e7f28e13-c859-43e6-abdb-8cf29e0681a5,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:38.761513 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-25ae7a7f-9eb2-43cc-ae53-d759518163a0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.266124 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.344590 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35232) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:39.387973 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_v2 [None req-7c7c4946-436a-424f-b1cb-c0226f697dcb admin admin] Deleting subnet 4c8f23cd-59c3-43ba-a990-3dfaf32f8cf7 {{(pid=103243) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:25:39.390939 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7c7c4946-436a-424f-b1cb-c0226f697dcb admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.424682 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7c7c4946-436a-424f-b1cb-c0226f697dcb admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-9292937'] for subnet, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.463491 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7c7c4946-436a-424f-b1cb-c0226f697dcb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.580686 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7c7c4946-436a-424f-b1cb-c0226f697dcb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8721838', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9106635'] for subnet, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.606670 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7c4946-436a-424f-b1cb-c0226f697dcb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4c8f23cd-59c3-43ba-a990-3dfaf32f8cf7,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:39.610486 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7c7c4946-436a-424f-b1cb-c0226f697dcb admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.613680 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-7c7c4946-436a-424f-b1cb-c0226f697dcb admin admin] 10.222.0.76 "DELETE /v2.0/subnets/4c8f23cd-59c3-43ba-a990-3dfaf32f8cf7 HTTP/1.1" status: 204 len: 168 time: 0.2680964 Nov 24 11:25:39.616409 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35234) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:39.682353 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.764009 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.783782 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d']}} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:39.793448 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd17edd0c-57ba-4458-9e65-d12987ea086d') {'for_net_delete': True} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:39.793747 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd17edd0c-57ba-4458-9e65-d12987ea086d') {} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:39.802946 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-9292944'] for segment, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.816398 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.823030 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] Releasing vlan 1235 on physical network physnet1 to pool {{(pid=103243) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:25:39.823453 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8721920'] for segment, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: Traceback (most recent call last): Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: timer() Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: cb(*args, **kw) Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: return func(*args, **kwargs) Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: self._notify() Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: self.callback(batched_events) Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: event.method(event) Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: return f(self, *a, **k) Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._get(url).json() Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: return self.request(url, 'GET', **kwargs) Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:25:39.825084 dv-cinder-804035-18-iscsi neutron-server[103243]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:25:39.963649 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.968921 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:39.972104 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] 10.222.0.76 "DELETE /v2.0/networks/256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d HTTP/1.1" status: 204 len: 168 time: 0.3546073 Nov 24 11:25:39.982927 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60a59e0b-073f-4526-a654-32bf9752cee2 admin admin] Pushing event deleted for resources: {'Network': ['ID=256ce9f9-31fa-4f61-8f1b-8d2ae4b99e5d,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:40.294066 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35238) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:40.333501 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-af56dfa3-3715-4356-b2e6-462b38106cf5 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=f3594395ceb848e1bcdcf0fa1a6f78b4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0382998 Nov 24 11:25:40.336033 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35240) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:40.382363 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-daebced7-d6bc-4ff6-9e19-3924d02fdd8d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:40.402887 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-daebced7-d6bc-4ff6-9e19-3924d02fdd8d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:40.523945 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-daebced7-d6bc-4ff6-9e19-3924d02fdd8d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:40.526530 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-daebced7-d6bc-4ff6-9e19-3924d02fdd8d admin admin] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:40.527805 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-daebced7-d6bc-4ff6-9e19-3924d02fdd8d admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/732f4c54-3fb7-459d-86f5-6a9c38558de9 HTTP/1.1" status: 204 len: 168 time: 0.1908364 Nov 24 11:25:40.535450 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daebced7-d6bc-4ff6-9e19-3924d02fdd8d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=732f4c54-3fb7-459d-86f5-6a9c38558de9,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:41.157982 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-91ff5ce8-d7dd-446f-a4fc-3ce9274b498c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:41.493248 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35262) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:41.587129 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1236384317-network', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:41.723465 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Made reservation on behalf of c672667e55bd470cba00102a41b7ea85 for: {'network': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:25:41.726535 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:41.735510 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:41.807734 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:41.883690 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:41.909908 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1213} {{(pid=103244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:25:41.921095 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0136a3ca-283c-4ef9-bab2-3b05d55d1699,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:41.927232 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:41.927600 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.segments_db [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Added segment a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3 of type vlan for network 50c03ad4-9543-459f-a58f-7999897d09ac Nov 24 11:25:41.969608 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:42.052205 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:42.053184 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:25:42.054085 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:42.114493 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] Pushing event updated for resources: {'Network': ['ID=50c03ad4-9543-459f-a58f-7999897d09ac,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:42.124284 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 50c03ad4-9543-459f-a58f-7999897d09ac details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:25:42.194461 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-e0e627f3-55b6-4bbf-8ae9-97677021b28f admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.7000666 Nov 24 11:25:42.197387 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35266) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:42.208309 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-67d901fa-682b-4b73-8fab-48632d29d5fa admin admin] Request body: {'subnet': {'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1236384317-subnet', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'ip_version': 4}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:42.331860 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-67d901fa-682b-4b73-8fab-48632d29d5fa admin admin] Made reservation on behalf of c672667e55bd470cba00102a41b7ea85 for: {'subnet': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:25:42.334131 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-67d901fa-682b-4b73-8fab-48632d29d5fa admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-8480549'] for subnet, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:42.480902 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:42.577789 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-67d901fa-682b-4b73-8fab-48632d29d5fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8698972', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-8480535'] for subnet, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:42.632127 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67d901fa-682b-4b73-8fab-48632d29d5fa admin admin] Pushing event updated for resources: {'Subnet': ['ID=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:42.639701 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-67d901fa-682b-4b73-8fab-48632d29d5fa admin admin] Checking segment: {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103244) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:25:42.640046 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67d901fa-682b-4b73-8fab-48632d29d5fa admin admin] Network hostable DHCP agents. Network: 50c03ad4-9543-459f-a58f-7999897d09ac, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103244) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:25:42.703570 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-67d901fa-682b-4b73-8fab-48632d29d5fa admin admin] Network 50c03ad4-9543-459f-a58f-7999897d09ac is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103244) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:25:42.772163 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-67d901fa-682b-4b73-8fab-48632d29d5fa admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 50c03ad4-9543-459f-a58f-7999897d09ac) {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:25:42.776861 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67d901fa-682b-4b73-8fab-48632d29d5fa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:25:42.777950 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-67d901fa-682b-4b73-8fab-48632d29d5fa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:42.783718 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d79b3582-fb61-4018-9770-808a78790dff None None] Network 50c03ad4-9543-459f-a58f-7999897d09ac requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:25:42.872574 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-67d901fa-682b-4b73-8fab-48632d29d5fa admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.6741350 Nov 24 11:25:42.875142 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35268) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:42.879236 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:42.927558 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1e1181f3-c521-552f-a8c5-b0ec988a193c-50c03ad4-9543-459f-a58f-7999897d09ac', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe'}]}} from dv-cinder-804035-18-iscsi. {{(pid=103245) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 11:25:42.928416 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:42.978965 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1010094', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:42.980365 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1009794', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-534758', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-985777', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-654'] for router, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:43.035704 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:43.056695 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.db_base_plugin_common [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Allocated IP 172.20.0.2 (50c03ad4-9543-459f-a58f-7999897d09ac/7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe/15a0a169-e87f-4bf7-930d-de986f01a061) {{(pid=103245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:25:43.197001 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Publish callbacks [] for port, precommit_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:43.247256 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:43.276192 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:43.316615 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Network 50c03ad4-9543-459f-a58f-7999897d09ac is already hosted by enough agents. {{(pid=103245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:25:43.319228 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.base_scheduler [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Resources bound (agent type, host, resource id): {{(pid=103245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:25:43.323095 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Received port after_create {{(pid=103245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:25:43.329794 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Pushing event updated for resources: {'Port': ['ID=15a0a169-e87f-4bf7-930d-de986f01a061,revision_number=1']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:43.340022 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:43.340373 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:43.340706 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:43.341032 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:43.341357 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:43.341678 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:43.341999 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:43.342315 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:43.342632 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:43.342944 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:43.343260 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:43.343595 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:43.393559 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Attempting to bind port 15a0a169-e87f-4bf7-930d-de986f01a061 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:25:43.393846 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Attempting to bind port 15a0a169-e87f-4bf7-930d-de986f01a061 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:25:43.394204 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Attempting to bind port 15a0a169-e87f-4bf7-930d-de986f01a061 on network 50c03ad4-9543-459f-a58f-7999897d09ac {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:25:43.400270 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 25, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:25:43.405819 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Checking segment: {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:25:43.405819 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:43.405819 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Bound using segment: {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:25:43.405819 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Bound port: 15a0a169-e87f-4bf7-930d-de986f01a061, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:25:43.405819 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:43.467695 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] For port 15a0a169-e87f-4bf7-930d-de986f01a061, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:25:43.471049 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] For port 15a0a169-e87f-4bf7-930d-de986f01a061, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=15a0a169-e87f-4bf7-930d-de986f01a061,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:25:43.592693 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:43.655895 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ae69a68-d95b-4750-ab3e-a7ddec97bd88 None None] Pushing event updated for resources: {'Port': ['ID=15a0a169-e87f-4bf7-930d-de986f01a061,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:43.832815 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:43.853509 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:43.958911 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Allocated IP 172.27.3.24 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/04914236-5365-496a-bed5-57e1bc421493) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:25:44.059154 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:44.086888 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:44.158176 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:44.198406 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:25:44.201267 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:25:44.204697 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:25:44.210231 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Pushing event updated for resources: {'Port': ['ID=04914236-5365-496a-bed5-57e1bc421493,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:44.505558 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:44.525588 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c8a6ec4-d8c0-488b-af10-3cd33549a54e None None] Network 50c03ad4-9543-459f-a58f-7999897d09ac requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:25:44.596162 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-6b2b711e-decc-4cf3-ac91-35d5bb74fffd None None] Provisioning complete for port 15a0a169-e87f-4bf7-930d-de986f01a061 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:44.596875 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6b2b711e-decc-4cf3-ac91-35d5bb74fffd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:44.703952 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1009813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-942685'] for router, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:44.749455 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6b2b711e-decc-4cf3-ac91-35d5bb74fffd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:44.792570 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-6b2b711e-decc-4cf3-ac91-35d5bb74fffd None None] For port 15a0a169-e87f-4bf7-930d-de986f01a061, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=15a0a169-e87f-4bf7-930d-de986f01a061,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:25:44.818085 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:44.883375 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6b2b711e-decc-4cf3-ac91-35d5bb74fffd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:44.917383 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Router 5ca98cd5-c317-441e-88ed-60cdfa54be52 is scheduled to L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 with binding_index 1 {{(pid=103244) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 11:25:44.934656 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b2b711e-decc-4cf3-ac91-35d5bb74fffd None None] Pushing event updated for resources: {'Port': ['ID=15a0a169-e87f-4bf7-930d-de986f01a061,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:45.002498 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-f3c60db0-5aa6-4618-a72b-9843af26aad8 None None] Provisioning complete for port 15a0a169-e87f-4bf7-930d-de986f01a061 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:45.002857 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f3c60db0-5aa6-4618-a72b-9843af26aad8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:45.025542 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:25:45.038506 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Sync routers for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:25:45.054652 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:25:45.055260 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:25:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:45.106108 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] Publish callbacks [] for router, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:45.107403 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-81e59012-29fe-4ef6-bffe-9fccd8fb0a5c admin admin] 10.222.0.76 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.2312980 Nov 24 11:25:45.110125 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35270) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:45.191640 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:25:45.376929 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:44Z', 'revision_number': 3, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:43Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:45.408463 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Checking router: 5ca98cd5-c317-441e-88ed-60cdfa54be52 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:25:45.408825 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Updating router 5ca98cd5-c317-441e-88ed-60cdfa54be52 port 04914236-5365-496a-bed5-57e1bc421493 binding host dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:25:45.430255 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 15a0a169-e87f-4bf7-930d-de986f01a061 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:25:45.456665 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:45.524311 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:45.569075 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 15a0a169-e87f-4bf7-930d-de986f01a061 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:45.569443 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:45.679965 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Allocated IP 172.20.0.1 (50c03ad4-9543-459f-a58f-7999897d09ac/7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe/42750708-69ee-4c4a-b960-54454ae9313f) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:25:45.786446 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:45.895391 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:45.920367 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Publish callbacks [] for port, precommit_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:45.940043 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Network 50c03ad4-9543-459f-a58f-7999897d09ac is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:25:45.942783 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:25:45.946768 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:25:45.969592 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Pushing event updated for resources: {'Port': ['ID=42750708-69ee-4c4a-b960-54454ae9313f,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:45.990602 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1009482'] for router_interface, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:45.992003 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:46.049550 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Attempting to bind port 04914236-5365-496a-bed5-57e1bc421493 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:25:46.049917 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Attempting to bind port 04914236-5365-496a-bed5-57e1bc421493 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:25:46.050280 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Attempting to bind port 04914236-5365-496a-bed5-57e1bc421493 on network fa6231d1-a629-42bc-a091-20035dee3542 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:25:46.052269 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b691e8-3d48-461a-8581-48ccd3f726bf None None] Pushing event updated for resources: {'Port': ['ID=04914236-5365-496a-bed5-57e1bc421493,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:46.060919 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 25, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:25:46.061986 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Checking segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:25:46.062592 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:46.063116 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Bound using segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:25:46.063761 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Bound port: 04914236-5365-496a-bed5-57e1bc421493, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:25:46.065206 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:46.119420 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] For port 04914236-5365-496a-bed5-57e1bc421493, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:25:46.122515 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] For port 04914236-5365-496a-bed5-57e1bc421493, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=04914236-5365-496a-bed5-57e1bc421493,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:25:46.200256 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-ae2fc8c0-94f3-40e7-a4d8-71ec6d24ce97 None None] Provisioning complete for port 42750708-69ee-4c4a-b960-54454ae9313f triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:46.200542 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-ae2fc8c0-94f3-40e7-a4d8-71ec6d24ce97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:46.214027 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:46.223926 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:46.268443 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-ae2fc8c0-94f3-40e7-a4d8-71ec6d24ce97 None None] Port 42750708-69ee-4c4a-b960-54454ae9313f cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:25:46.295211 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2b691e8-3d48-461a-8581-48ccd3f726bf None None] Pushing event updated for resources: {'Port': ['ID=04914236-5365-496a-bed5-57e1bc421493,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:46.297657 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:25:46.298238 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:25:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:46.385588 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Publish callbacks [] for port, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:46.406417 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:25:46.448759 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8699083'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:46.519225 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Pushing event updated for resources: {'Port': ['ID=42750708-69ee-4c4a-b960-54454ae9313f,revision_number=2']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:46.524462 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-636370', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1009638'] for router_interface, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:46.605104 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:45Z', 'revision_number': 1, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:46.623584 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Network 50c03ad4-9543-459f-a58f-7999897d09ac is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:25:46.625042 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:25:46.636636 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-718b0ac1-0d1f-4029-97ea-8c32057df83e None None] The sync data for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi is: [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:45Z', 'revision_number': 1, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:25:46.769020 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Router 5ca98cd5-c317-441e-88ed-60cdfa54be52 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:25:46.890683 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-9c501e12-91c5-4bd4-ac6c-e99470d74f14 None None] Provisioning complete for port 42750708-69ee-4c4a-b960-54454ae9313f triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:46.891042 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-9c501e12-91c5-4bd4-ac6c-e99470d74f14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:46.899166 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:25:46.905369 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-569e08d9-5c88-4ffa-b641-df2791f88e17 admin admin] 10.222.0.76 "PUT /v2.0/routers/5ca98cd5-c317-441e-88ed-60cdfa54be52/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7942426 Nov 24 11:25:46.934517 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-9c501e12-91c5-4bd4-ac6c-e99470d74f14 None None] Port 42750708-69ee-4c4a-b960-54454ae9313f cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:25:47.464185 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 04914236-5365-496a-bed5-57e1bc421493 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:25:47.513502 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 04914236-5365-496a-bed5-57e1bc421493 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:47.513867 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:47.597836 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:47.621146 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] For port 04914236-5365-496a-bed5-57e1bc421493, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=04914236-5365-496a-bed5-57e1bc421493,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:25:47.677853 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35286) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:47.682793 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-292028924-network', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:47.695050 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:47.749872 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Pushing event updated for resources: {'Port': ['ID=04914236-5365-496a-bed5-57e1bc421493,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:47.780300 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Made reservation on behalf of d3a0be31ba5a44fd9fa8f4eb91244039 for: {'network': 1} {{(pid=103244) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:25:47.782808 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for network, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:47.796589 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:47.879548 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:47.943889 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:47.971673 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 1248} {{(pid=103244) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 24 11:25:47.977823 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=74983816-d7df-4c9f-853a-4b802ba6c787,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:47.983798 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:47.984138 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.segments_db [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Added segment cae3f2af-a231-4163-8e6d-d9f38b413291 of type vlan for network 7e9bc114-a1bf-495d-a3b2-2df5b40b217e Nov 24 11:25:48.023519 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8789863726632'] for network, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:48.103945 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224'] for network, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:48.104925 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:25:48.105506 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:48.162819 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] Pushing event updated for resources: {'Network': ['ID=7e9bc114-a1bf-495d-a3b2-2df5b40b217e,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:48.172482 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Network 7e9bc114-a1bf-495d-a3b2-2df5b40b217e details requested by agent ovs-agent-dv-cinder-804035-18-iscsi with host dv-cinder-804035-18-iscsi {{(pid=103245) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 24 11:25:48.232273 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-58f7ffab-078f-4f03-8e7e-a16866367ae3 admin admin] 10.222.0.76 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5532858 Nov 24 11:25:48.235126 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35288) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:48.240097 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-929ab976-372d-4ebb-b54b-63222eb62567 admin admin] Request body: {'subnet': {'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-292028924-subnet', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'ip_version': 4}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:48.346551 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-929ab976-372d-4ebb-b54b-63222eb62567 admin admin] Made reservation on behalf of d3a0be31ba5a44fd9fa8f4eb91244039 for: {'subnet': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:25:48.349037 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-929ab976-372d-4ebb-b54b-63222eb62567 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-9106670'] for subnet, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:48.563131 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-929ab976-372d-4ebb-b54b-63222eb62567 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-8721775', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-9106652'] for subnet, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:48.587217 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Sync routers for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:25:48.597402 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:25:48.597944 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:25:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:48.626366 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-929ab976-372d-4ebb-b54b-63222eb62567 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ac7ab3af-328c-48b0-bebe-86a3fa1cf134,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:48.631979 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-929ab976-372d-4ebb-b54b-63222eb62567 admin admin] Checking segment: {'id': 'cae3f2af-a231-4163-8e6d-d9f38b413291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1248, 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:25:48.631979 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-929ab976-372d-4ebb-b54b-63222eb62567 admin admin] Network hostable DHCP agents. Network: 7e9bc114-a1bf-495d-a3b2-2df5b40b217e, hostable agents: ['479ef866-45df-4cc7-a75f-3979c9784b48'], hosted agents: [] {{(pid=103243) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 24 11:25:48.700147 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-929ab976-372d-4ebb-b54b-63222eb62567 admin admin] Network 7e9bc114-a1bf-495d-a3b2-2df5b40b217e is scheduled to be hosted by DHCP agent 479ef866-45df-4cc7-a75f-3979c9784b48 with binding_index 1 {{(pid=103243) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 24 11:25:48.701706 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:25:48.780527 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-929ab976-372d-4ebb-b54b-63222eb62567 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804035-18-iscsi, 7e9bc114-a1bf-495d-a3b2-2df5b40b217e) {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:25:48.788531 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-929ab976-372d-4ebb-b54b-63222eb62567 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:25:48.790323 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-929ab976-372d-4ebb-b54b-63222eb62567 admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:48.793596 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9f015f5-57e5-405d-9f76-80d0e9a65503 None None] Network 7e9bc114-a1bf-495d-a3b2-2df5b40b217e requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:25:48.874585 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-929ab976-372d-4ebb-b54b-63222eb62567 admin admin] 10.222.0.76 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.6381755 Nov 24 11:25:48.876945 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35290) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:48.881306 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-292028924-router', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:48.909609 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 2, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:48.937509 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Checking router: 5ca98cd5-c317-441e-88ed-60cdfa54be52 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:25:48.937860 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Updating router 5ca98cd5-c317-441e-88ed-60cdfa54be52 port 42750708-69ee-4c4a-b960-54454ae9313f binding host dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:25:48.949094 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp1e1181f3-c521-552f-a8c5-b0ec988a193c-7e9bc114-a1bf-495d-a3b2-2df5b40b217e', 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'fixed_ips': [{'subnet_id': 'ac7ab3af-328c-48b0-bebe-86a3fa1cf134'}]}} from dv-cinder-804035-18-iscsi. {{(pid=103245) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 24 11:25:48.949982 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:48.963928 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:48.983895 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1010094', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-697'] for router, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:48.991938 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1009794', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-534758', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-985777', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-654'] for router, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.036780 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.090995 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.db_base_plugin_common [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Allocated IP 172.20.0.2 (7e9bc114-a1bf-495d-a3b2-2df5b40b217e/ac7ab3af-328c-48b0-bebe-86a3fa1cf134/8ae3028e-95ab-472c-a6be-91d53c64405f) {{(pid=103245) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:25:49.235897 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Publish callbacks [] for port, precommit_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.236689 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Publish callbacks [] for port, precommit_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.262804 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.303894 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170'] for port, after_create {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.341082 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Network 7e9bc114-a1bf-495d-a3b2-2df5b40b217e is already hosted by enough agents. {{(pid=103245) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:25:49.347467 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.scheduler.base_scheduler [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Resources bound (agent type, host, resource id): {{(pid=103245) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:25:49.349459 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.352061 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Received port after_create {{(pid=103245) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:25:49.359649 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Pushing event updated for resources: {'Port': ['ID=8ae3028e-95ab-472c-a6be-91d53c64405f,revision_number=1']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:49.416776 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Pushing event updated for resources: {'Port': ['ID=42750708-69ee-4c4a-b960-54454ae9313f,revision_number=3']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:49.430118 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:49.430893 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:49.431475 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:49.432020 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:49.432708 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:49.433294 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:49.433688 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:49.434192 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:49.434535 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:49.435082 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:49.435657 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:49.436045 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103246) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:25:49.445729 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Attempting to bind port 8ae3028e-95ab-472c-a6be-91d53c64405f on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:25:49.446858 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Attempting to bind port 8ae3028e-95ab-472c-a6be-91d53c64405f by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'cae3f2af-a231-4163-8e6d-d9f38b413291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1248, 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:25:49.447046 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Attempting to bind port 8ae3028e-95ab-472c-a6be-91d53c64405f on network 7e9bc114-a1bf-495d-a3b2-2df5b40b217e {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:25:49.458943 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 25, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:25:49.458943 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Checking segment: {'id': 'cae3f2af-a231-4163-8e6d-d9f38b413291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1248, 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:25:49.458943 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.461329 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Bound using segment: {'id': 'cae3f2af-a231-4163-8e6d-d9f38b413291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1248, 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:25:49.461329 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Bound port: 8ae3028e-95ab-472c-a6be-91d53c64405f, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cae3f2af-a231-4163-8e6d-d9f38b413291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1248, 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:25:49.461329 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.475964 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 04914236-5365-496a-bed5-57e1bc421493 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:25:49.499132 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Attempting to bind port 42750708-69ee-4c4a-b960-54454ae9313f on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:25:49.499503 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Attempting to bind port 42750708-69ee-4c4a-b960-54454ae9313f by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:25:49.499936 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Attempting to bind port 42750708-69ee-4c4a-b960-54454ae9313f on network 50c03ad4-9543-459f-a58f-7999897d09ac {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:25:49.506603 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 25, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:25:49.507084 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Checking segment: {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:25:49.507596 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.508041 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Bound using segment: {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:25:49.509415 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Bound port: 42750708-69ee-4c4a-b960-54454ae9313f, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'}}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:25:49.510089 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.580644 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] For port 8ae3028e-95ab-472c-a6be-91d53c64405f, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:25:49.585634 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] For port 8ae3028e-95ab-472c-a6be-91d53c64405f, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=8ae3028e-95ab-472c-a6be-91d53c64405f,segment=NetworkSegment(cae3f2af-a231-4163-8e6d-d9f38b413291),segment_id=cae3f2af-a231-4163-8e6d-d9f38b413291)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:25:49.589069 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 04914236-5365-496a-bed5-57e1bc421493 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:49.589447 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.589812 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.600411 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] For port 42750708-69ee-4c4a-b960-54454ae9313f, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:25:49.607010 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] For port 42750708-69ee-4c4a-b960-54454ae9313f, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=42750708-69ee-4c4a-b960-54454ae9313f,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:25:49.614567 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.683625 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.701463 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.720829 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Allocated IP 172.27.3.225 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/53980824-f312-4480-8664-cc03f9d7e928) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:25:49.733962 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-5e040d08-9df4-4459-9b63-31a3406886e6 None None] Provisioning complete for port 42750708-69ee-4c4a-b960-54454ae9313f triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:49.734317 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5e040d08-9df4-4459-9b63-31a3406886e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.787196 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:25:49.787664 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:25:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:49.792666 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c401b7d-0130-4257-8b6c-29c8b41874d9 None None] Pushing event updated for resources: {'Port': ['ID=8ae3028e-95ab-472c-a6be-91d53c64405f,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:49.856271 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78386983-06a3-46dd-95cf-648bd27f99f1 None None] Pushing event updated for resources: {'Port': ['ID=42750708-69ee-4c4a-b960-54454ae9313f,revision_number=4']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:49.863990 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5e040d08-9df4-4459-9b63-31a3406886e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.897342 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:49.912593 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-5e040d08-9df4-4459-9b63-31a3406886e6 None None] For port 42750708-69ee-4c4a-b960-54454ae9313f, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=42750708-69ee-4c4a-b960-54454ae9313f,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:25:49.961156 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:25:49.980654 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-5e040d08-9df4-4459-9b63-31a3406886e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:50.010563 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:50.051431 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:25:50.067400 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:25:50.076972 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e040d08-9df4-4459-9b63-31a3406886e6 None None] Pushing event updated for resources: {'Port': ['ID=42750708-69ee-4c4a-b960-54454ae9313f,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:50.079097 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:25:50.105820 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Pushing event updated for resources: {'Port': ['ID=53980824-f312-4480-8664-cc03f9d7e928,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:50.121767 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-1e80852a-e759-480f-bd91-e5adf3845965 None None] Provisioning complete for port 42750708-69ee-4c4a-b960-54454ae9313f triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:50.122924 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-1e80852a-e759-480f-bd91-e5adf3845965 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:50.310583 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:50.342369 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7ed0f139-21e9-4f17-bc63-577c791103e7 None None] The sync data for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi is: [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:25:50.434458 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:50.644715 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1009813', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-942685'] for router, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:50.843172 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Router cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 is scheduled to L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 with binding_index 1 {{(pid=103243) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 24 11:25:50.917273 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d1e71dfb-b99d-4ab6-83cb-91cf191a798f None None] Network 7e9bc114-a1bf-495d-a3b2-2df5b40b217e requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:25:50.970232 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:25:50.986527 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Sync routers for ids ['cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:25:51.020158 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-fa5c6fe8-1a55-40c9-a034-a907187c8083 None None] Provisioning complete for port 8ae3028e-95ab-472c-a6be-91d53c64405f triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:51.020530 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fa5c6fe8-1a55-40c9-a034-a907187c8083 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:51.023234 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Routers {'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:25:51.023891 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:25:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:51.050809 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] Publish callbacks [] for router, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:51.052103 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-8ac0d637-fb76-49ae-8fd6-db331d10e14e admin admin] 10.222.0.76 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.1742203 Nov 24 11:25:51.054711 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35292) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:51.374279 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Set router cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:25:51.445312 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fa5c6fe8-1a55-40c9-a034-a907187c8083 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:51.530070 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-fa5c6fe8-1a55-40c9-a034-a907187c8083 None None] For port 8ae3028e-95ab-472c-a6be-91d53c64405f, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=8ae3028e-95ab-472c-a6be-91d53c64405f,segment=NetworkSegment(cae3f2af-a231-4163-8e6d-d9f38b413291),segment_id=cae3f2af-a231-4163-8e6d-d9f38b413291)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:25:51.567642 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 42750708-69ee-4c4a-b960-54454ae9313f up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:25:51.613383 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fa5c6fe8-1a55-40c9-a034-a907187c8083 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:51.688489 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa5c6fe8-1a55-40c9-a034-a907187c8083 None None] Pushing event updated for resources: {'Port': ['ID=8ae3028e-95ab-472c-a6be-91d53c64405f,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:51.705255 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 42750708-69ee-4c4a-b960-54454ae9313f triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:51.705623 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:51.709302 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'name': 'tempest-TestVolumeBootPattern-292028924-router', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '53980824-f312-4480-8664-cc03f9d7e928', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:48Z', 'updated_at': '2021-11-24T11:25:50Z', 'revision_number': 3, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'gw_port': {'id': '53980824-f312-4480-8664-cc03f9d7e928', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:18:fa:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:49Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:51.762150 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:51.767350 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Checking router: cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:25:51.767706 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Updating router cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 port 53980824-f312-4480-8664-cc03f9d7e928 binding host dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:25:51.802899 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:51.806097 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-8fc73e39-6f25-4431-802b-9dfcc739a76f None None] Provisioning complete for port 8ae3028e-95ab-472c-a6be-91d53c64405f triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:51.806641 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-8fc73e39-6f25-4431-802b-9dfcc739a76f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:51.917841 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Allocated IP 172.20.0.1 (7e9bc114-a1bf-495d-a3b2-2df5b40b217e/ac7ab3af-328c-48b0-bebe-86a3fa1cf134/3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:25:51.980487 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 8ae3028e-95ab-472c-a6be-91d53c64405f up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:25:52.019198 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.121404 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.133101 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 8ae3028e-95ab-472c-a6be-91d53c64405f triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:52.133569 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.159415 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Network 7e9bc114-a1bf-495d-a3b2-2df5b40b217e is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:25:52.162281 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:25:52.168661 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:25:52.198914 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Pushing event updated for resources: {'Port': ['ID=3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:52.212894 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1009482'] for router_interface, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.228258 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Publish callbacks [] for port, precommit_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.307963 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.361184 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af424921-dfd7-4219-a672-256f4abcd275 None None] Pushing event updated for resources: {'Port': ['ID=53980824-f312-4480-8664-cc03f9d7e928,revision_number=2']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:52.365649 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Attempting to bind port 53980824-f312-4480-8664-cc03f9d7e928 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:25:52.366017 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Attempting to bind port 53980824-f312-4480-8664-cc03f9d7e928 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:25:52.366360 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Attempting to bind port 53980824-f312-4480-8664-cc03f9d7e928 on network fa6231d1-a629-42bc-a091-20035dee3542 {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:25:52.372482 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 25, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:25:52.372855 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Checking segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103245) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:25:52.373256 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.373628 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Bound using segment: {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'} {{(pid=103245) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:25:52.374093 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.managers [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Bound port: 53980824-f312-4480-8664-cc03f9d7e928, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bdf7c96b-efac-48c4-9baf-722b3b6d5627', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542'}}] {{(pid=103245) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:25:52.374466 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.433079 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-0d684add-9039-4a94-b147-2ad3319f3fc5 None None] Provisioning complete for port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:52.433438 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0d684add-9039-4a94-b147-2ad3319f3fc5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.442436 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.455875 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] For port 53980824-f312-4480-8664-cc03f9d7e928, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103245) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:25:52.474151 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] For port 53980824-f312-4480-8664-cc03f9d7e928, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=53980824-f312-4480-8664-cc03f9d7e928,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:25:52.479148 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-0d684add-9039-4a94-b147-2ad3319f3fc5 None None] Port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:25:52.527097 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.582964 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Routers {'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:25:52.583600 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:25:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:52.589255 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af424921-dfd7-4219-a672-256f4abcd275 None None] Pushing event updated for resources: {'Port': ['ID=53980824-f312-4480-8664-cc03f9d7e928,revision_number=3']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:52.607217 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.663682 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.694546 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] Set router cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:25:52.732503 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Pushing event updated for resources: {'Port': ['ID=3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:52.735792 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-636370', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1009638'] for router_interface, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:52.829637 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Network 7e9bc114-a1bf-495d-a3b2-2df5b40b217e is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:25:52.830947 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:25:52.905226 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'name': 'tempest-TestVolumeBootPattern-292028924-router', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '53980824-f312-4480-8664-cc03f9d7e928', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:48Z', 'updated_at': '2021-11-24T11:25:52Z', 'revision_number': 4, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'gw_port': {'id': '53980824-f312-4480-8664-cc03f9d7e928', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:18:fa:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:49Z', 'updated_at': '2021-11-24T11:25:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1', 'name': '', 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'mac_address': 'fa:16:3e:b2:68:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'ac7ab3af-328c-48b0-bebe-86a3fa1cf134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:51Z', 'updated_at': '2021-11-24T11:25:51Z', 'revision_number': 1, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'subnets': [{'id': 'ac7ab3af-328c-48b0-bebe-86a3fa1cf134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:52.935787 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13d45f51-5562-4b0a-9ef8-8011db6ad53c None None] The sync data for ids ['cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'] in dv-cinder-804035-18-iscsi is: [{'id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'name': 'tempest-TestVolumeBootPattern-292028924-router', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '53980824-f312-4480-8664-cc03f9d7e928', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:48Z', 'updated_at': '2021-11-24T11:25:52Z', 'revision_number': 4, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'gw_port': {'id': '53980824-f312-4480-8664-cc03f9d7e928', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:18:fa:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:49Z', 'updated_at': '2021-11-24T11:25:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1', 'name': '', 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'mac_address': 'fa:16:3e:b2:68:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'ac7ab3af-328c-48b0-bebe-86a3fa1cf134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:51Z', 'updated_at': '2021-11-24T11:25:51Z', 'revision_number': 1, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'subnets': [{'id': 'ac7ab3af-328c-48b0-bebe-86a3fa1cf134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:25:52.959776 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Router cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:25:53.082152 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:25:53.088401 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-18f358e3-f091-41a5-ada1-31c7b36ba79d admin admin] 10.222.0.76 "PUT /v2.0/routers/cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0326090 Nov 24 11:25:53.105023 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-cf9681ec-29d5-4e44-9072-328af512d07a None None] Provisioning complete for port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:53.105562 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-cf9681ec-29d5-4e44-9072-328af512d07a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:53.158619 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-cf9681ec-29d5-4e44-9072-328af512d07a None None] Port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:25:53.421079 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 8ae3028e-95ab-472c-a6be-91d53c64405f up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:25:53.477278 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 8ae3028e-95ab-472c-a6be-91d53c64405f triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:53.477995 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:53.691670 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35300) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:53.696500 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-714343d0-1233-4f75-a3d3-d8a82e76e0dd tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1021474358', 'description': 'tempest-secgroup-smoke-1021474358 description', 'project_id': 'c672667e55bd470cba00102a41b7ea85'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:53.786370 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-714343d0-1233-4f75-a3d3-d8a82e76e0dd tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:53.863616 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-714343d0-1233-4f75-a3d3-d8a82e76e0dd tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.001056 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-714343d0-1233-4f75-a3d3-d8a82e76e0dd tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.031923 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-714343d0-1233-4f75-a3d3-d8a82e76e0dd tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3995c765-1ba2-40f8-bda1-be920c60a01a,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:54.099803 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-714343d0-1233-4f75-a3d3-d8a82e76e0dd tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.104828 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-714343d0-1233-4f75-a3d3-d8a82e76e0dd tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.4085057 Nov 24 11:25:54.105099 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35302) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:54.109710 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-6837b8ce-697b-4d6f-9fbf-d55ff54ecda2 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'security_group_rule': {'security_group_id': '3995c765-1ba2-40f8-bda1-be920c60a01a', 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:54.194314 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6837b8ce-697b-4d6f-9fbf-d55ff54ecda2 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.250057 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6837b8ce-697b-4d6f-9fbf-d55ff54ecda2 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.326258 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6837b8ce-697b-4d6f-9fbf-d55ff54ecda2 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.346655 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6837b8ce-697b-4d6f-9fbf-d55ff54ecda2 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e53eb0b2-df46-41fa-ac2f-e0ba5d715434,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:54.420110 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6837b8ce-697b-4d6f-9fbf-d55ff54ecda2 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.421331 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-6837b8ce-697b-4d6f-9fbf-d55ff54ecda2 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3152792 Nov 24 11:25:54.424214 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35304) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:54.428731 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-ba5b5bf5-bffa-4f1a-91f2-0242de7833ae tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'security_group_rule': {'security_group_id': '3995c765-1ba2-40f8-bda1-be920c60a01a', 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:54.514551 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ba5b5bf5-bffa-4f1a-91f2-0242de7833ae tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.572646 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ba5b5bf5-bffa-4f1a-91f2-0242de7833ae tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.641073 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ba5b5bf5-bffa-4f1a-91f2-0242de7833ae tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.661513 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba5b5bf5-bffa-4f1a-91f2-0242de7833ae tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7b7e475c-305c-4a40-9eca-89c76ad51512,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:54.725594 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-ba5b5bf5-bffa-4f1a-91f2-0242de7833ae tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.726979 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-ba5b5bf5-bffa-4f1a-91f2-0242de7833ae tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3018074 Nov 24 11:25:54.729872 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35306) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:54.734369 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-047ecab0-dbfa-42d3-9e46-0162bb65bef4 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'security_group_rule': {'security_group_id': '3995c765-1ba2-40f8-bda1-be920c60a01a', 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:54.826253 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-047ecab0-dbfa-42d3-9e46-0162bb65bef4 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.863816 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Sync routers for ids ['cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:25:54.873575 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Routers {'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:25:54.874277 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:25:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:54.887554 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-047ecab0-dbfa-42d3-9e46-0162bb65bef4 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.963564 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-047ecab0-dbfa-42d3-9e46-0162bb65bef4 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:54.978927 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-047ecab0-dbfa-42d3-9e46-0162bb65bef4 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9721e53c-bb7c-404b-afaf-56252ff653a7,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:54.979159 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Set router cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:25:55.059696 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-047ecab0-dbfa-42d3-9e46-0162bb65bef4 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.061016 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-047ecab0-dbfa-42d3-9e46-0162bb65bef4 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3302026 Nov 24 11:25:55.063728 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35308) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:55.067999 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-1d47d50a-6b16-443c-bdea-610054b37c53 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'security_group_rule': {'security_group_id': '3995c765-1ba2-40f8-bda1-be920c60a01a', 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:55.148281 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1d47d50a-6b16-443c-bdea-610054b37c53 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.175262 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'name': 'tempest-TestVolumeBootPattern-292028924-router', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '53980824-f312-4480-8664-cc03f9d7e928', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:48Z', 'updated_at': '2021-11-24T11:25:52Z', 'revision_number': 4, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'gw_port': {'id': '53980824-f312-4480-8664-cc03f9d7e928', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:18:fa:38', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:49Z', 'updated_at': '2021-11-24T11:25:52Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1', 'name': '', 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'mac_address': 'fa:16:3e:b2:68:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'ac7ab3af-328c-48b0-bebe-86a3fa1cf134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:51Z', 'updated_at': '2021-11-24T11:25:52Z', 'revision_number': 2, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'subnets': [{'id': 'ac7ab3af-328c-48b0-bebe-86a3fa1cf134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:55.202877 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Checking router: cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:25:55.203224 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Updating router cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 binding host dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 24 11:25:55.207525 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1d47d50a-6b16-443c-bdea-610054b37c53 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.232398 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.294380 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1d47d50a-6b16-443c-bdea-610054b37c53 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.311668 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d47d50a-6b16-443c-bdea-610054b37c53 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=458ddd49-1a20-4b59-8589-a59f0921998a,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:55.403241 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1d47d50a-6b16-443c-bdea-610054b37c53 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.407329 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-1d47d50a-6b16-443c-bdea-610054b37c53 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3398466 Nov 24 11:25:55.407497 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35310) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:55.411808 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [None req-8ac9c14c-b6a8-44da-9317-688b9ce2881d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'security_group_rule': {'security_group_id': '3995c765-1ba2-40f8-bda1-be920c60a01a', 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:55.431375 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 53980824-f312-4480-8664-cc03f9d7e928 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:25:55.479111 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 53980824-f312-4480-8664-cc03f9d7e928 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:55.479667 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.488902 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.securitygroups_db [None req-8ac9c14c-b6a8-44da-9317-688b9ce2881d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Project c672667e55bd470cba00102a41b7ea85 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 11:25:55.494852 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac9c14c-b6a8-44da-9317-688b9ce2881d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.495055 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Publish callbacks [] for port, precommit_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.553228 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac9c14c-b6a8-44da-9317-688b9ce2881d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.557988 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.562986 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.578083 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] For port 53980824-f312-4480-8664-cc03f9d7e928, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=53980824-f312-4480-8664-cc03f9d7e928,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:25:55.609960 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-046b96b0-d62e-42fe-b2e8-4d8f128c5c4c None None] Pushing event updated for resources: {'Port': ['ID=3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1,revision_number=3']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:55.615242 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac9c14c-b6a8-44da-9317-688b9ce2881d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.640651 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ac9c14c-b6a8-44da-9317-688b9ce2881d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=241c1460-aa87-4245-94eb-24d4b91f3cfb,revision_number=0']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:55.644456 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.667409 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Attempting to bind port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 on host dv-cinder-804035-18-iscsi for vnic_type normal with profile {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:25:55.667775 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Attempting to bind port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 by drivers openvswitch,hyperv on host dv-cinder-804035-18-iscsi at level 0 using segments [{'id': 'cae3f2af-a231-4163-8e6d-d9f38b413291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1248, 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e'}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:25:55.668136 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Attempting to bind port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 on network 7e9bc114-a1bf-495d-a3b2-2df5b40b217e {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:25:55.673401 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Checking agent: {'id': '033d7244-2d78-4de3-95fe-40e19fd0c65f', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804035-18-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 7, 15), 'started_at': datetime.datetime(2021, 11, 24, 11, 7, 45), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 25, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804035-18-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:25:55.673773 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Checking segment: {'id': 'cae3f2af-a231-4163-8e6d-d9f38b413291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1248, 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103246) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:25:55.674157 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.674546 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Bound using segment: {'id': 'cae3f2af-a231-4163-8e6d-d9f38b413291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1248, 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e'} {{(pid=103246) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:25:55.675144 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.managers [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Bound port: 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1, host: dv-cinder-804035-18-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cae3f2af-a231-4163-8e6d-d9f38b413291', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1248, 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e'}}] {{(pid=103246) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:25:55.675568 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.699931 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Pushing event updated for resources: {'Port': ['ID=53980824-f312-4480-8664-cc03f9d7e928,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:55.714472 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-8ac9c14c-b6a8-44da-9317-688b9ce2881d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.715794 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-8ac9c14c-b6a8-44da-9317-688b9ce2881d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3073685 Nov 24 11:25:55.718539 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35312) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:25:55.729572 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-c0f5539f-833a-4098-b842-1f8815fce10c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'security_group_rule': {'security_group_id': '3995c765-1ba2-40f8-bda1-be920c60a01a', 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:25:55.740553 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] For port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1, host dv-cinder-804035-18-iscsi, cleared binding levels {{(pid=103246) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:25:55.744509 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.plugins.ml2.db [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] For port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1, host dv-cinder-804035-18-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1,segment=NetworkSegment(cae3f2af-a231-4163-8e6d-d9f38b413291),segment_id=cae3f2af-a231-4163-8e6d-d9f38b413291)] {{(pid=103246) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:25:55.860836 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.securitygroups_db [None req-c0f5539f-833a-4098-b842-1f8815fce10c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Project c672667e55bd470cba00102a41b7ea85 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 24 11:25:55.861057 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron_lib.callbacks.manager [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103246) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.866214 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c0f5539f-833a-4098-b842-1f8815fce10c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.895741 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-eb2c6efa-d8fc-4eaa-8f14-c72347e05a2d None None] Provisioning complete for port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:55.896259 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-eb2c6efa-d8fc-4eaa-8f14-c72347e05a2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:55.924341 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-046b96b0-d62e-42fe-b2e8-4d8f128c5c4c None None] Pushing event updated for resources: {'Port': ['ID=3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1,revision_number=4']} {{(pid=103246) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:55.928309 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Routers {'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:25:55.928929 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:25:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:55.943876 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c0f5539f-833a-4098-b842-1f8815fce10c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:56.003225 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-eb2c6efa-d8fc-4eaa-8f14-c72347e05a2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:56.013356 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c0f5539f-833a-4098-b842-1f8815fce10c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-973447'] for security_group_rule, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:56.029523 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0f5539f-833a-4098-b842-1f8815fce10c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e492f5e2-1893-4b2b-ae17-118214642b05,revision_number=0']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:56.038508 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-eb2c6efa-d8fc-4eaa-8f14-c72347e05a2d None None] For port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1,segment=NetworkSegment(cae3f2af-a231-4163-8e6d-d9f38b413291),segment_id=cae3f2af-a231-4163-8e6d-d9f38b413291)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:25:56.049068 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] Set router cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:25:56.126249 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-eb2c6efa-d8fc-4eaa-8f14-c72347e05a2d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:56.152407 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c0f5539f-833a-4098-b842-1f8815fce10c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group_rule, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:56.153940 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-c0f5539f-833a-4098-b842-1f8815fce10c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.4344065 Nov 24 11:25:56.178623 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb2c6efa-d8fc-4eaa-8f14-c72347e05a2d None None] Pushing event updated for resources: {'Port': ['ID=3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:25:56.252295 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-87bd6014-7b43-4125-b2c9-5eb375337464 None None] Provisioning complete for port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:56.252488 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-87bd6014-7b43-4125-b2c9-5eb375337464 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:56.262140 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'name': 'tempest-TestVolumeBootPattern-292028924-router', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '53980824-f312-4480-8664-cc03f9d7e928', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:48Z', 'updated_at': '2021-11-24T11:25:52Z', 'revision_number': 4, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'gw_port': {'id': '53980824-f312-4480-8664-cc03f9d7e928', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:18:fa:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:49Z', 'updated_at': '2021-11-24T11:25:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1', 'name': '', 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'mac_address': 'fa:16:3e:b2:68:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'ac7ab3af-328c-48b0-bebe-86a3fa1cf134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:51Z', 'updated_at': '2021-11-24T11:25:55Z', 'revision_number': 4, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'subnets': [{'id': 'ac7ab3af-328c-48b0-bebe-86a3fa1cf134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:25:56.289509 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0001a870-684e-4521-86f5-dbbfbe19e35e None None] The sync data for ids ['cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'] in dv-cinder-804035-18-iscsi is: [{'id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'name': 'tempest-TestVolumeBootPattern-292028924-router', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '53980824-f312-4480-8664-cc03f9d7e928', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:48Z', 'updated_at': '2021-11-24T11:25:52Z', 'revision_number': 4, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'gw_port': {'id': '53980824-f312-4480-8664-cc03f9d7e928', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:18:fa:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:49Z', 'updated_at': '2021-11-24T11:25:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1', 'name': '', 'network_id': '7e9bc114-a1bf-495d-a3b2-2df5b40b217e', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'mac_address': 'fa:16:3e:b2:68:84', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'device_owner': 'network:router_interface', 'standard_attr_id': 685, 'fixed_ips': [{'subnet_id': 'ac7ab3af-328c-48b0-bebe-86a3fa1cf134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:51Z', 'updated_at': '2021-11-24T11:25:55Z', 'revision_number': 4, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'subnets': [{'id': 'ac7ab3af-328c-48b0-bebe-86a3fa1cf134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:25:57.427469 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 53980824-f312-4480-8664-cc03f9d7e928 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:25:57.477851 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 53980824-f312-4480-8664-cc03f9d7e928 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:57.478811 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:25:57.566489 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 up at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:25:57.612561 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Provisioning complete for port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:25:57.612938 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:04.066313 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:26:08.728503 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-21af3f57-1c86-4fb2-a33e-421f345ce582 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:09.240953 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:11.154951 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-edbf30ed-03c7-43b0-be42-622ee5a68a05 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:12.499832 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:13.915221 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-b898deca-45f5-4bea-97cc-72f0bc1fca27 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1021474358&fields=id&tenant_id=c672667e55bd470cba00102a41b7ea85 HTTP/1.1" status: 200 len: 267 time: 0.0436640 Nov 24 11:26:14.019633 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-4512dc06-a9fc-4cc9-b3f7-085eddb693b9 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:14.021104 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-4512dc06-a9fc-4cc9-b3f7-085eddb693b9 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 812 time: 0.0993681 Nov 24 11:26:14.036285 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-99feeeac-9b78-4c2e-8313-2ababeeff7b1 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/quotas/c672667e55bd470cba00102a41b7ea85 HTTP/1.1" status: 200 len: 375 time: 0.0095196 Nov 24 11:26:14.065613 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:14.091848 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-f5687872-85ca-4140-b27f-85d23dc4624f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0503230 Nov 24 11:26:14.106944 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-db085e1b-3d56-4145-8590-b38ae3fc38ae service neutron] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103244) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:26:14.107934 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-db085e1b-3d56-4145-8590-b38ae3fc38ae service neutron] 10.222.0.76 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049660 Nov 24 11:26:14.196092 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-b2cc4dc5-e37a-4181-9bef-8ae8a927b1c5 service neutron] 10.222.0.76 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821614 Nov 24 11:26:14.287812 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-6f07ac55-1ef0-4571-834b-c99a0c85e17e service neutron] 10.222.0.76 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0857985 Nov 24 11:26:14.854141 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:14.875694 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7008c88f-7a5f-4e88-916a-48c36a6180ed req-5cd7f094-4ea3-4175-a2a9-7d95c4192fed tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 210 time: 0.0283654 Nov 24 11:26:15.951760 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b0c6f949-c976-4859-8c37-011cd86ae3a4 req-daaf7c4a-e1c1-4837-9773-966bb4a51e4f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 210 time: 0.0258801 Nov 24 11:26:17.027595 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-161d9c88-4167-43e6-b770-849e39ab9d44 req-0b35d6c9-72d4-4353-afdf-066b75ad1bd7 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 210 time: 0.0248880 Nov 24 11:26:18.120920 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7636ee61-d5da-4549-9c16-09e0a4aed4a6 req-165346cd-3431-4f7e-9b55-6e8d0db8e2a8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 210 time: 0.0258570 Nov 24 11:26:19.217057 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-25d79625-2888-4e21-9994-59065ff39b11 req-6e0961cf-4b28-4552-b186-f4f93864ceb6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 210 time: 0.0300622 Nov 24 11:26:19.994683 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-fca10b02-ae3f-4537-a825-60d394754ea0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:19.996267 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-fca10b02-ae3f-4537-a825-60d394754ea0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 812 time: 0.1043189 Nov 24 11:26:20.057727 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-6e2a9bde-411c-499f-92c4-77714b71127e tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c672667e55bd470cba00102a41b7ea85 HTTP/1.1" status: 200 len: 380 time: 0.0524054 Nov 24 11:26:20.068135 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'port': {'device_id': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'admin_state_up': True, 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'security_groups': ['3995c765-1ba2-40f8-bda1-be920c60a01a']}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:26:20.234736 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Made reservation on behalf of c672667e55bd470cba00102a41b7ea85 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:26:20.238425 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:20.311824 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-91f1e3be-1317-4aad-8eb7-eec98063b843 req-fbcda219-6c66-4c2c-b45d-25bf6c5faa79 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 210 time: 0.0257475 Nov 24 11:26:20.365340 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Allocated IP 172.20.0.3 (50c03ad4-9543-459f-a58f-7999897d09ac/7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe/d12f82cf-31ed-4f3b-b4be-f657675842d5) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:26:20.504847 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:20.577710 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:20.621799 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Network 50c03ad4-9543-459f-a58f-7999897d09ac is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:26:20.624684 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:26:20.629170 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:26:20.636499 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'Port': ['ID=d12f82cf-31ed-4f3b-b4be-f657675842d5,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:26:20.686516 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:20.687151 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:20.772100 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-5b36747c-31b9-481b-8d60-b8ec674cf59b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7080896 Nov 24 11:26:20.786788 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-85d30a9b-ccd8-4575-9aae-c58d0fd27ec6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] http://10.222.0.76:9696/v2.0/extensions returned with HTTP 200 {{(pid=103243) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 24 11:26:20.787836 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-85d30a9b-ccd8-4575-9aae-c58d0fd27ec6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0097404 Nov 24 11:26:20.892013 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Request body: {'port': {'device_id': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:26:20.917815 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-57b4f76b-7e5c-44b6-aa22-e5d56fe073de None None] Provisioning complete for port d12f82cf-31ed-4f3b-b4be-f657675842d5 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:26:20.917815 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-57b4f76b-7e5c-44b6-aa22-e5d56fe073de None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:20.949651 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-57b4f76b-7e5c-44b6-aa22-e5d56fe073de None None] Port d12f82cf-31ed-4f3b-b4be-f657675842d5 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:26:20.949897 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:21.205881 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d12f82cf-31ed-4f3b-b4be-f657675842d5 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:26:21.213377 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:21.225042 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Transition to ACTIVE for port object d12f82cf-31ed-4f3b-b4be-f657675842d5 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:26:21.291816 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:21.346390 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Pushing event updated for resources: {'Port': ['ID=d12f82cf-31ed-4f3b-b4be-f657675842d5,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:26:21.424765 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Attempting to bind port d12f82cf-31ed-4f3b-b4be-f657675842d5 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:26:21.425294 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Attempting to bind port d12f82cf-31ed-4f3b-b4be-f657675842d5 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:26:21.425696 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Attempting to bind port d12f82cf-31ed-4f3b-b4be-f657675842d5 on network 50c03ad4-9543-459f-a58f-7999897d09ac {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:26:21.430707 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Port d12f82cf-31ed-4f3b-b4be-f657675842d5 on network 50c03ad4-9543-459f-a58f-7999897d09ac not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:26:21.436335 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Attempting to bind port d12f82cf-31ed-4f3b-b4be-f657675842d5 on network 50c03ad4-9543-459f-a58f-7999897d09ac {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:26:21.436472 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50505c41-1ff0-4bbc-ab0b-87d306572e6e req-6ec9aa1c-7b75-4a7c-a1ab-16eb86e2f695 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:21.436472 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-50505c41-1ff0-4bbc-ab0b-87d306572e6e req-6ec9aa1c-7b75-4a7c-a1ab-16eb86e2f695 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 943 time: 0.0508618 Nov 24 11:26:21.437044 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 26, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:26:21.437232 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Checking segment: {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:26:21.437612 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Bound using segment: {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:26:21.438038 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Bound port: d12f82cf-31ed-4f3b-b4be-f657675842d5, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:26:21.438386 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:21.490693 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-50505c41-1ff0-4bbc-ab0b-87d306572e6e req-5cba0e6a-a184-46f6-8572-60ec2a9338f6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479405 Nov 24 11:26:21.507948 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] For port d12f82cf-31ed-4f3b-b4be-f657675842d5, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:26:21.511060 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] For port d12f82cf-31ed-4f3b-b4be-f657675842d5, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=d12f82cf-31ed-4f3b-b4be-f657675842d5,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:26:21.574368 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:21.611531 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:21.612166 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:21.613683 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] 10.222.0.86 "PUT /v2.0/ports/d12f82cf-31ed-4f3b-b4be-f657675842d5 HTTP/1.1" status: 200 len: 1093 time: 0.8165901 Nov 24 11:26:21.614108 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'tag': 'd12f82cf-31ed-4f3b-b4be-f657675842d5'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:26:21.616347 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-079ad4c3-f8b9-4207-9b5d-54439684befa" -d '{"events": [{"name": "network-changed", "server_uuid": "5dc3853b-cccd-4891-b724-3215d5ad9624", "tag": "d12f82cf-31ed-4f3b-b4be-f657675842d5"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:26:21.641833 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbd8b72c-b1c5-44ee-9ba1-daa16e3d7f07 service neutron] Pushing event updated for resources: {'Port': ['ID=d12f82cf-31ed-4f3b-b4be-f657675842d5,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:26:21.730009 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:26:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25fbf706-5781-4fd3-bc76-2b65c3651624 x-openstack-request-id: req-25fbf706-5781-4fd3-bc76-2b65c3651624 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:26:21.730300 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5dc3853b-cccd-4891-b724-3215d5ad9624", "tag": "d12f82cf-31ed-4f3b-b4be-f657675842d5", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:26:21.730586 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-25fbf706-5781-4fd3-bc76-2b65c3651624 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:26:21.731006 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'tag': 'd12f82cf-31ed-4f3b-b4be-f657675842d5', 'status': 'completed', 'code': 200} Nov 24 11:26:21.747279 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-2777ea25-85f1-457a-b62a-98dafe7a19a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:21.748703 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-2777ea25-85f1-457a-b62a-98dafe7a19a6 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 1096 time: 0.0470188 Nov 24 11:26:21.795614 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-fe33ea22-3999-4e21-91b6-dbd2579fe911 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d12f82cf-31ed-4f3b-b4be-f657675842d5 HTTP/1.1" status: 200 len: 217 time: 0.0381784 Nov 24 11:26:21.848289 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-81817793-a93f-4eac-b6e8-17a41c98a171 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:21.849717 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-81817793-a93f-4eac-b6e8-17a41c98a171 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0471115 Nov 24 11:26:21.895880 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-942863f4-4d82-46f5-84b1-814b9bc7dd17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:21.897485 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-942863f4-4d82-46f5-84b1-814b9bc7dd17 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0404975 Nov 24 11:26:21.990057 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-871aea67-a19e-4f44-9af1-375c834739af service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0857034 Nov 24 11:26:22.081119 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-d8d40732-7cb5-415a-ba63-7c3d3e917233 req-b99f5027-138f-4cee-8577-b7a76d1ab3ff service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831645 Nov 24 11:26:22.293927 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079ad4c3-f8b9-4207-9b5d-54439684befa req-25421d9d-35cb-4248-84af-f219ba9e615b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:22.295429 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-079ad4c3-f8b9-4207-9b5d-54439684befa req-25421d9d-35cb-4248-84af-f219ba9e615b service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 1096 time: 0.0402009 Nov 24 11:26:22.389208 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079ad4c3-f8b9-4207-9b5d-54439684befa req-d7e3240d-b43f-42e2-9d98-2ca72e378a8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:22.390666 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-079ad4c3-f8b9-4207-9b5d-54439684befa req-d7e3240d-b43f-42e2-9d98-2ca72e378a8e service neutron] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 914 time: 0.0877800 Nov 24 11:26:22.430829 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-079ad4c3-f8b9-4207-9b5d-54439684befa req-3c55f809-4858-48ac-b899-506ef52ea39e service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d12f82cf-31ed-4f3b-b4be-f657675842d5 HTTP/1.1" status: 200 len: 217 time: 0.0326736 Nov 24 11:26:22.483705 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079ad4c3-f8b9-4207-9b5d-54439684befa req-554e5db1-a2f8-4ce9-91d4-c8d0f5926d4b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:22.485095 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-079ad4c3-f8b9-4207-9b5d-54439684befa req-554e5db1-a2f8-4ce9-91d4-c8d0f5926d4b service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0460799 Nov 24 11:26:22.530126 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079ad4c3-f8b9-4207-9b5d-54439684befa req-12b2456d-4099-4226-85b3-41acd132fe95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:22.531648 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-079ad4c3-f8b9-4207-9b5d-54439684befa req-12b2456d-4099-4226-85b3-41acd132fe95 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0392365 Nov 24 11:26:22.612792 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c794b729-d5be-408b-b671-df5b17a37ca5 req-6a939223-88fa-4f50-9b45-30af37b0201c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:22.614332 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c794b729-d5be-408b-b671-df5b17a37ca5 req-6a939223-88fa-4f50-9b45-30af37b0201c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 943 time: 0.0505652 Nov 24 11:26:22.621668 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-079ad4c3-f8b9-4207-9b5d-54439684befa req-7342a1f0-fae6-4370-b0c7-56c4918599f2 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0827217 Nov 24 11:26:22.668050 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c794b729-d5be-408b-b671-df5b17a37ca5 req-8a8b9e57-bfe6-47a3-a92e-d96f958e82ee tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476208 Nov 24 11:26:22.714568 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-079ad4c3-f8b9-4207-9b5d-54439684befa req-35190d23-f31d-463c-acaf-bbe750e2eee1 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856931 Nov 24 11:26:23.784681 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f441c0b8-bcb1-46c0-8244-37e263afd7de req-0b2a43ce-0f14-49ee-8bd1-cafd300d2de9 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:23.786156 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f441c0b8-bcb1-46c0-8244-37e263afd7de req-0b2a43ce-0f14-49ee-8bd1-cafd300d2de9 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 943 time: 0.0484519 Nov 24 11:26:23.835974 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f441c0b8-bcb1-46c0-8244-37e263afd7de req-714da421-4a1f-47c6-9b0b-1ccda34b0c17 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439351 Nov 24 11:26:24.948802 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69d12e1f-58b6-4546-b77b-9609cbeafd48 req-98b01889-f443-4ab2-b45f-8b2e6da88d44 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:24.950235 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-69d12e1f-58b6-4546-b77b-9609cbeafd48 req-98b01889-f443-4ab2-b45f-8b2e6da88d44 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 943 time: 0.0485315 Nov 24 11:26:24.997149 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-69d12e1f-58b6-4546-b77b-9609cbeafd48 req-50ef0c01-462b-4bbf-9913-4bd8dfb3aa73 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410657 Nov 24 11:26:26.112708 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b505f56-bef5-4ef3-b02d-93568dfcf9b3 req-57c43d5a-e875-4df3-bea2-4efa0b3067e6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:26.114166 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1b505f56-bef5-4ef3-b02d-93568dfcf9b3 req-57c43d5a-e875-4df3-bea2-4efa0b3067e6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 943 time: 0.0519781 Nov 24 11:26:26.162409 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-1b505f56-bef5-4ef3-b02d-93568dfcf9b3 req-a5280052-f584-42c4-a8df-8f6b59495a6f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422847 Nov 24 11:26:27.273785 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5723d78-f04b-4f13-84a4-c81f7997355a req-a05be516-3a1c-4933-bad4-259999cae0a0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:27.275434 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d5723d78-f04b-4f13-84a4-c81f7997355a req-a05be516-3a1c-4933-bad4-259999cae0a0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 943 time: 0.0478306 Nov 24 11:26:27.323179 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d5723d78-f04b-4f13-84a4-c81f7997355a req-41b03e48-01a2-42ce-bba5-2115ba0f7016 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418596 Nov 24 11:26:28.437278 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf915cb5-1a13-449f-83f9-daffabae80f2 req-05a09df0-8d02-4d58-9c7c-61a4c78ec12f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:28.438720 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cf915cb5-1a13-449f-83f9-daffabae80f2 req-05a09df0-8d02-4d58-9c7c-61a4c78ec12f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 943 time: 0.0480537 Nov 24 11:26:28.491186 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cf915cb5-1a13-449f-83f9-daffabae80f2 req-bbfca530-0de4-4f12-a28b-70e431fe3f51 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461063 Nov 24 11:26:29.602739 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a812d93-7a7d-438e-9773-da32678a1fc2 req-66d761fc-7fc7-46ad-a4a7-694c4e1eba18 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:29.604204 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3a812d93-7a7d-438e-9773-da32678a1fc2 req-66d761fc-7fc7-46ad-a4a7-694c4e1eba18 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 943 time: 0.0477810 Nov 24 11:26:29.652484 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3a812d93-7a7d-438e-9773-da32678a1fc2 req-ba17f210-e28e-44a9-b080-dbe087dd32d6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423875 Nov 24 11:26:29.866914 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device d12f82cf-31ed-4f3b-b4be-f657675842d5 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:26:29.969394 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port d12f82cf-31ed-4f3b-b4be-f657675842d5, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=d12f82cf-31ed-4f3b-b4be-f657675842d5,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:26:29.971144 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': 'd12f82cf-31ed-4f3b-b4be-f657675842d5', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'port_id': 'd12f82cf-31ed-4f3b-b4be-f657675842d5', 'mac_address': 'fa:16:3e:31:a2:f4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1213, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:26:30.009835 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:30.022290 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d12f82cf-31ed-4f3b-b4be-f657675842d5 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:26:30.040908 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port d12f82cf-31ed-4f3b-b4be-f657675842d5, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=d12f82cf-31ed-4f3b-b4be-f657675842d5,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:26:30.097333 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:30.142873 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=d12f82cf-31ed-4f3b-b4be-f657675842d5,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:26:30.306030 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['d12f82cf-31ed-4f3b-b4be-f657675842d5'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:26:30.765202 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d0d13d2-06fd-4d76-934c-0524f3dda92e req-6052d0eb-37f1-4972-ba94-2eab62a9c6fa tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:30.766658 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5d0d13d2-06fd-4d76-934c-0524f3dda92e req-6052d0eb-37f1-4972-ba94-2eab62a9c6fa tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 944 time: 0.0491235 Nov 24 11:26:30.816008 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5d0d13d2-06fd-4d76-934c-0524f3dda92e req-ded19794-2f1e-44e0-8be7-d8bd6a31edc6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425069 Nov 24 11:26:31.875563 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device d12f82cf-31ed-4f3b-b4be-f657675842d5 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:26:31.934625 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cccf158d-7a8e-44fa-aaba-07ad83265b1f req-e8678e20-f061-4902-9a02-1b498e13a702 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:31.936099 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cccf158d-7a8e-44fa-aaba-07ad83265b1f req-e8678e20-f061-4902-9a02-1b498e13a702 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 944 time: 0.0520937 Nov 24 11:26:31.979617 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port d12f82cf-31ed-4f3b-b4be-f657675842d5 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:26:31.983550 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port d12f82cf-31ed-4f3b-b4be-f657675842d5 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:26:31.983915 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:31.984934 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-cccf158d-7a8e-44fa-aaba-07ad83265b1f req-aef78fd5-4196-402e-978e-183bcacf5460 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428412 Nov 24 11:26:32.061324 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:32.083808 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd12f82cf-31ed-4f3b-b4be-f657675842d5'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:26:32.086011 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dbf11622-06ff-4f93-944a-a5c3794aa063" -d '{"events": [{"server_uuid": "5dc3853b-cccd-4891-b724-3215d5ad9624", "name": "network-vif-plugged", "status": "completed", "tag": "d12f82cf-31ed-4f3b-b4be-f657675842d5"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:26:32.098836 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port d12f82cf-31ed-4f3b-b4be-f657675842d5, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=d12f82cf-31ed-4f3b-b4be-f657675842d5,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:26:32.177188 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:26:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3c0f1a91-f2ef-4b0c-8827-700b903749e1 x-openstack-request-id: req-3c0f1a91-f2ef-4b0c-8827-700b903749e1 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:26:32.177476 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5dc3853b-cccd-4891-b724-3215d5ad9624", "name": "network-vif-plugged", "status": "completed", "tag": "d12f82cf-31ed-4f3b-b4be-f657675842d5", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:26:32.177721 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-3c0f1a91-f2ef-4b0c-8827-700b903749e1 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:26:32.178131 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd12f82cf-31ed-4f3b-b4be-f657675842d5', 'code': 200} Nov 24 11:26:32.185395 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:32.233718 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=d12f82cf-31ed-4f3b-b4be-f657675842d5,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:26:32.506539 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-221d5a0c-e4fe-4be3-845f-f54bcbba1be4 req-51071c78-a971-4637-9be9-720503c993ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:32.508069 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-221d5a0c-e4fe-4be3-845f-f54bcbba1be4 req-51071c78-a971-4637-9be9-720503c993ea service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 1098 time: 0.0409572 Nov 24 11:26:32.554638 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-221d5a0c-e4fe-4be3-845f-f54bcbba1be4 req-6c06c089-493c-4e3d-91ad-971cb5090399 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381217 Nov 24 11:26:33.099136 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d2f3317-115e-44bc-a4a9-d0897c249863 req-5b8a75a8-5d73-4822-bd50-235957a870b7 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:33.100637 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7d2f3317-115e-44bc-a4a9-d0897c249863 req-5b8a75a8-5d73-4822-bd50-235957a870b7 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 945 time: 0.0486081 Nov 24 11:26:33.148135 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7d2f3317-115e-44bc-a4a9-d0897c249863 req-8314b7c8-9e28-4ce9-bbd1-8584830d1fa0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416806 Nov 24 11:26:34.268415 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4c61698-4582-4089-8132-9f893c4033f4 req-adb05405-e970-4f70-a4e2-b21c5ed19461 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:34.270079 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b4c61698-4582-4089-8132-9f893c4033f4 req-adb05405-e970-4f70-a4e2-b21c5ed19461 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 945 time: 0.0539899 Nov 24 11:26:34.562366 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b4c61698-4582-4089-8132-9f893c4033f4 req-1a03b5dc-deae-42f1-94c1-798417f93f11 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2861490 Nov 24 11:26:34.682017 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e31535d-3dd5-47ac-8409-28ebb7cffcf9 req-0606dae5-4201-4f6f-b021-b62895f8b61d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:34.683529 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6e31535d-3dd5-47ac-8409-28ebb7cffcf9 req-0606dae5-4201-4f6f-b021-b62895f8b61d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 945 time: 0.0536151 Nov 24 11:26:34.742341 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6e31535d-3dd5-47ac-8409-28ebb7cffcf9 req-36ae7068-2778-4f8f-be0d-86d79992eedc tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496299 Nov 24 11:26:34.766355 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35504) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:26:34.853041 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a03e6717-9ba6-4bc5-9716-f59692e2a6d7 tempest-TestVolumeBootPattern-1409714024 tempest-TestVolumeBootPattern-1409714024-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:34.854544 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-a03e6717-9ba6-4bc5-9716-f59692e2a6d7 tempest-TestVolumeBootPattern-1409714024 tempest-TestVolumeBootPattern-1409714024-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 1093 time: 0.0872045 Nov 24 11:26:34.857434 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35508) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:26:34.861601 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'floatingip': {'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'port_id': 'd12f82cf-31ed-4f3b-b4be-f657675842d5', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address': '172.20.0.3'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:26:34.939431 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:35.036094 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:35.138721 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Allocated IP 172.27.3.63 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/28beda15-905f-48ee-9178-8e92ae358cab) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:26:35.236201 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:35.314586 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:35.350352 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:26:35.355136 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:26:35.358560 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:26:35.387343 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'Port': ['ID=28beda15-905f-48ee-9178-8e92ae358cab,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:26:35.401295 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:26:35.401584 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:26:35.401928 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:26:35.402264 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:26:35.402594 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:26:35.402923 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:26:35.403251 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:26:35.403603 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:26:35.403929 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:26:35.404251 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:26:35.404571 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:26:35.404890 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:26:35.724283 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:35.842759 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:35.994549 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for port, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:36.039975 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8699083'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:36.110076 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'Port': ['ID=28beda15-905f-48ee-9178-8e92ae358cab,revision_number=2']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:26:36.118392 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:36.217309 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.l3_db [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Floating IP 54303b0b-9e33-4514-95db-75ec43597cf5 associated. External IP: 172.27.3.63, port: d12f82cf-31ed-4f3b-b4be-f657675842d5. Nov 24 11:26:36.424474 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Router 5ca98cd5-c317-441e-88ed-60cdfa54be52 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:26:36.530941 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:26:36.540690 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e604d349-4efa-4d73-a6c4-ad588b0fd5eb None None] Sync routers for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:26:36.549641 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e604d349-4efa-4d73-a6c4-ad588b0fd5eb None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:26:36.550379 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-e604d349-4efa-4d73-a6c4-ad588b0fd5eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:26:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:26:36.631268 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:36.655890 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-e604d349-4efa-4d73-a6c4-ad588b0fd5eb None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:26:36.658116 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-551c6d48-4082-4f90-b1ee-84948e37d2ad tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.7997165 Nov 24 11:26:36.658693 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'tag': 'd12f82cf-31ed-4f3b-b4be-f657675842d5'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:26:36.661228 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e172e353-df78-46f8-9e6e-16844bbcf7dd" -d '{"events": [{"name": "network-changed", "server_uuid": "5dc3853b-cccd-4891-b724-3215d5ad9624", "tag": "d12f82cf-31ed-4f3b-b4be-f657675842d5"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:26:36.761590 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:26:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a77220af-4bad-4887-9da2-687a728b625d x-openstack-request-id: req-a77220af-4bad-4887-9da2-687a728b625d {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:26:36.761884 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5dc3853b-cccd-4891-b724-3215d5ad9624", "tag": "d12f82cf-31ed-4f3b-b4be-f657675842d5", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:26:36.762136 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-a77220af-4bad-4887-9da2-687a728b625d {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:26:36.762536 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'tag': 'd12f82cf-31ed-4f3b-b4be-f657675842d5', 'status': 'completed', 'code': 200} Nov 24 11:26:36.830680 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e172e353-df78-46f8-9e6e-16844bbcf7dd req-adba04ba-23de-4d32-a7cc-03e58d5c3f3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:36.832448 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e172e353-df78-46f8-9e6e-16844bbcf7dd req-adba04ba-23de-4d32-a7cc-03e58d5c3f3f service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 1098 time: 0.0447550 Nov 24 11:26:36.892341 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-e604d349-4efa-4d73-a6c4-ad588b0fd5eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '54303b0b-9e33-4514-95db-75ec43597cf5', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.63', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': 'd12f82cf-31ed-4f3b-b4be-f657675842d5', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 697, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:31:a2:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:26:35Z', 'updated_at': '2021-11-24T11:26:35Z', 'revision_number': 0, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:26:36.921629 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e604d349-4efa-4d73-a6c4-ad588b0fd5eb None None] Checking router: 5ca98cd5-c317-441e-88ed-60cdfa54be52 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:26:36.922230 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e172e353-df78-46f8-9e6e-16844bbcf7dd req-350ec6a6-e87e-4208-8d75-dd8bdf044480 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:36.923715 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e172e353-df78-46f8-9e6e-16844bbcf7dd req-350ec6a6-e87e-4208-8d75-dd8bdf044480 service neutron] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 914 time: 0.0843031 Nov 24 11:26:36.930261 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e604d349-4efa-4d73-a6c4-ad588b0fd5eb None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:26:36.930849 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-e604d349-4efa-4d73-a6c4-ad588b0fd5eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:26:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:26:36.994590 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e172e353-df78-46f8-9e6e-16844bbcf7dd req-5517dec2-bcca-4b3b-aaee-bda66f9c1dc9 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d12f82cf-31ed-4f3b-b4be-f657675842d5 HTTP/1.1" status: 200 len: 998 time: 0.0636594 Nov 24 11:26:37.045173 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e172e353-df78-46f8-9e6e-16844bbcf7dd req-ade44c65-cc6c-408a-bd30-17848a09c638 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:37.046651 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e172e353-df78-46f8-9e6e-16844bbcf7dd req-ade44c65-cc6c-408a-bd30-17848a09c638 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0457699 Nov 24 11:26:37.092086 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e172e353-df78-46f8-9e6e-16844bbcf7dd req-cbbcf2e5-7df3-4fff-ae49-b55b515a877f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:26:37.093564 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e172e353-df78-46f8-9e6e-16844bbcf7dd req-cbbcf2e5-7df3-4fff-ae49-b55b515a877f service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0403364 Nov 24 11:26:37.155578 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-e604d349-4efa-4d73-a6c4-ad588b0fd5eb None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:26:37.184800 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e172e353-df78-46f8-9e6e-16844bbcf7dd req-7d1e83af-bf02-4b85-b4e5-c67315155b75 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841000 Nov 24 11:26:37.272223 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e172e353-df78-46f8-9e6e-16844bbcf7dd req-c87e8482-3371-464b-a5f4-c6882764633b service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0804787 Nov 24 11:26:37.377013 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-e604d349-4efa-4d73-a6c4-ad588b0fd5eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '54303b0b-9e33-4514-95db-75ec43597cf5', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.63', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': 'd12f82cf-31ed-4f3b-b4be-f657675842d5', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 697, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:31:a2:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:26:35Z', 'updated_at': '2021-11-24T11:26:35Z', 'revision_number': 0, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:26:37.406170 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e604d349-4efa-4d73-a6c4-ad588b0fd5eb None None] The sync data for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi is: [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '54303b0b-9e33-4514-95db-75ec43597cf5', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.63', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': 'd12f82cf-31ed-4f3b-b4be-f657675842d5', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 697, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:31:a2:f4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:26:35Z', 'updated_at': '2021-11-24T11:26:35Z', 'revision_number': 0, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:26:37.586622 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1fedf17c-a76f-40c6-8eef-5c977f773b22 None None] New status for floating IP 54303b0b-9e33-4514-95db-75ec43597cf5: ACTIVE {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:26:38.748504 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f660573e-bb16-456b-8c22-d18227a0e129 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:39.263100 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:41.065567 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:26:41.156242 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-bb6a5904-80fb-475b-8a8c-90b684304557 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:42.499551 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:44.053507 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:26:44.800203 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:08.760605 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-6720917f-8e00-4db7-a2d0-689abebc6439 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:09.276095 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:11.170967 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fca0d70e-3717-41d3-8396-f8bc8c6aca09 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:12.485427 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:14.076382 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:14.828356 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:18.067452 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:27:19.721256 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-847b7fbc-e5cc-41ce-b6f2-1182b019d165 req-cf49b54a-9195-4fd5-95e5-c167734488d2 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0430007 Nov 24 11:27:19.805872 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-847b7fbc-e5cc-41ce-b6f2-1182b019d165 req-e417960e-d1dc-47ae-9589-2c308f756728 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:27:19.807356 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-847b7fbc-e5cc-41ce-b6f2-1182b019d165 req-e417960e-d1dc-47ae-9589-2c308f756728 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 1098 time: 0.0410171 Nov 24 11:27:19.908868 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-847b7fbc-e5cc-41ce-b6f2-1182b019d165 req-71df96ef-207c-457b-a9c5-1265427513d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:27:19.910329 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-847b7fbc-e5cc-41ce-b6f2-1182b019d165 req-71df96ef-207c-457b-a9c5-1265427513d1 service neutron] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 914 time: 0.0845668 Nov 24 11:27:19.976699 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-847b7fbc-e5cc-41ce-b6f2-1182b019d165 req-b8f96053-c33c-4dd7-8599-747a5a12b2c2 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d12f82cf-31ed-4f3b-b4be-f657675842d5 HTTP/1.1" status: 200 len: 1000 time: 0.0596919 Nov 24 11:27:20.024555 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-847b7fbc-e5cc-41ce-b6f2-1182b019d165 req-35fdc6c5-6513-410a-b537-a9392d483ecc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:27:20.025922 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-847b7fbc-e5cc-41ce-b6f2-1182b019d165 req-35fdc6c5-6513-410a-b537-a9392d483ecc service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0420485 Nov 24 11:27:20.070866 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-847b7fbc-e5cc-41ce-b6f2-1182b019d165 req-16283498-f721-483e-bb1a-a5ccc5bef868 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:27:20.072318 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-847b7fbc-e5cc-41ce-b6f2-1182b019d165 req-16283498-f721-483e-bb1a-a5ccc5bef868 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0381651 Nov 24 11:27:20.164179 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-847b7fbc-e5cc-41ce-b6f2-1182b019d165 req-c461b01b-2ca8-474f-ae98-8eb16df82c45 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839400 Nov 24 11:27:20.251659 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-847b7fbc-e5cc-41ce-b6f2-1182b019d165 req-d1993507-7412-4f8a-ba98-0392c5140b86 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0795841 Nov 24 11:27:38.738199 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-8a2882c1-d2eb-4dfd-8980-859bd87c8995 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:39.280977 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:41.166827 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-cdc6e344-9210-4c03-9118-d1aeab1b109c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:42.475401 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:44.058629 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:44.793323 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:27:55.067430 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:28:08.741957 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-72c89401-1933-43d6-88dc-add340d1c0c7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:09.292167 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:11.170421 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fafd16a7-83be-456f-8f42-0fb501352a89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:12.478864 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:14.130463 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:14.840834 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:21.759354 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-35ddf0cc-6f4e-4146-89ed-534ccb3e97d0 req-ace201c6-8730-4373-a8ce-b6e3d8c5aa00 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0427115 Nov 24 11:28:21.840848 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35ddf0cc-6f4e-4146-89ed-534ccb3e97d0 req-e5a23b65-50f2-4c8f-ad44-b30b3cd1800e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:21.842286 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-35ddf0cc-6f4e-4146-89ed-534ccb3e97d0 req-e5a23b65-50f2-4c8f-ad44-b30b3cd1800e service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 1098 time: 0.0409222 Nov 24 11:28:21.945341 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35ddf0cc-6f4e-4146-89ed-534ccb3e97d0 req-f4bbd791-05f1-4258-a3be-18c11a2ae3d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:21.946782 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-35ddf0cc-6f4e-4146-89ed-534ccb3e97d0 req-f4bbd791-05f1-4258-a3be-18c11a2ae3d7 service neutron] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 914 time: 0.0860450 Nov 24 11:28:22.010179 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-35ddf0cc-6f4e-4146-89ed-534ccb3e97d0 req-6af9988e-baf0-4088-acc3-001de6fd0bbd service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=d12f82cf-31ed-4f3b-b4be-f657675842d5 HTTP/1.1" status: 200 len: 1000 time: 0.0558674 Nov 24 11:28:22.056567 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35ddf0cc-6f4e-4146-89ed-534ccb3e97d0 req-9e986632-2482-4c68-9aba-a4131c03a83c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:22.057913 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-35ddf0cc-6f4e-4146-89ed-534ccb3e97d0 req-9e986632-2482-4c68-9aba-a4131c03a83c service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0411382 Nov 24 11:28:22.105472 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35ddf0cc-6f4e-4146-89ed-534ccb3e97d0 req-a59f5918-26ab-40d7-ab7d-4c91395f5c05 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:22.106919 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-35ddf0cc-6f4e-4146-89ed-534ccb3e97d0 req-a59f5918-26ab-40d7-ab7d-4c91395f5c05 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0426855 Nov 24 11:28:22.199507 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-35ddf0cc-6f4e-4146-89ed-534ccb3e97d0 req-768f21ea-fbaf-433e-9d07-d5d9486c01bd service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853326 Nov 24 11:28:22.290494 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-35ddf0cc-6f4e-4146-89ed-534ccb3e97d0 req-5774111a-9394-4895-b1f0-8953d2ad3955 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0835700 Nov 24 11:28:31.516150 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b73d20c-37ae-4241-80a6-c7598c4dc4fb req-13af0877-7877-43d9-888e-9b8844c25fe0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:31.517609 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6b73d20c-37ae-4241-80a6-c7598c4dc4fb req-13af0877-7877-43d9-888e-9b8844c25fe0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 945 time: 0.0502496 Nov 24 11:28:31.566375 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-6b73d20c-37ae-4241-80a6-c7598c4dc4fb req-d46a08d0-c3d9-456a-9c80-7be3f735e1fd tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427659 Nov 24 11:28:32.066529 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:28:32.685814 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff51d652-b06e-40a6-a485-beb75ee7c03f req-e83bbf8c-efa7-45d0-9164-1efad5dec9e0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:32.687276 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff51d652-b06e-40a6-a485-beb75ee7c03f req-e83bbf8c-efa7-45d0-9164-1efad5dec9e0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 945 time: 0.0530579 Nov 24 11:28:32.735133 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff51d652-b06e-40a6-a485-beb75ee7c03f req-50bb4709-bbfa-4d02-9b72-5711da58971d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412011 Nov 24 11:28:33.032102 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-58c7c818-36bf-4790-bcb0-d2c1fb2b802b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:33.033448 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-58c7c818-36bf-4790-bcb0-d2c1fb2b802b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 945 time: 0.0492799 Nov 24 11:28:33.120282 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Deleting port d12f82cf-31ed-4f3b-b4be-f657675842d5 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:28:33.120613 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:33.209289 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] For port d12f82cf-31ed-4f3b-b4be-f657675842d5, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=d12f82cf-31ed-4f3b-b4be-f657675842d5,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:28:33.210010 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:33.638380 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:33.638734 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:33.639037 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.l3_db [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Floating IP 54303b0b-9e33-4514-95db-75ec43597cf5 disassociated. External IP: 172.27.3.63, port: d12f82cf-31ed-4f3b-b4be-f657675842d5. Nov 24 11:28:33.639397 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Calling delete_port for d12f82cf-31ed-4f3b-b4be-f657675842d5 owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:28:33.812015 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:33.841602 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-97efe09e-88b4-44f3-9887-d9095627c276 req-bff7fbca-edf6-4039-82cb-5230b6007e35 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 210 time: 0.0276701 Nov 24 11:28:33.844655 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event deleted for resources: {'Port': ['ID=d12f82cf-31ed-4f3b-b4be-f657675842d5,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:28:33.858083 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:33.858556 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:33.859145 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:33.859513 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:33.859843 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:33.860176 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:33.860505 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:33.860832 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:33.861164 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:33.861485 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:33.861805 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:33.862124 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:33.970341 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Router 5ca98cd5-c317-441e-88ed-60cdfa54be52 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:28:34.077716 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:28:34.111491 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd2cc6de-2229-42c9-865d-8559a8fb6259 None None] Sync routers for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:28:34.120426 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] No DVR routers for this DVR port d12f82cf-31ed-4f3b-b4be-f657675842d5 on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:28:34.122846 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:34.126184 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dba11569-ef23-45ee-b17d-e74581c15ae4 req-367d02cc-53ac-4967-87f9-0101cacddde0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "DELETE /v2.0/ports/d12f82cf-31ed-4f3b-b4be-f657675842d5 HTTP/1.1" status: 204 len: 173 time: 1.0859356 Nov 24 11:28:34.126614 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'name': 'network-vif-deleted', 'tag': 'd12f82cf-31ed-4f3b-b4be-f657675842d5'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:28:34.128015 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd2cc6de-2229-42c9-865d-8559a8fb6259 None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:28:34.128617 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-bd2cc6de-2229-42c9-865d-8559a8fb6259 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:28:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:28:34.128922 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-67ee5783-49d7-4d16-aa7f-b44682d63ec8" -d '{"events": [{"server_uuid": "5dc3853b-cccd-4891-b724-3215d5ad9624", "name": "network-vif-deleted", "tag": "d12f82cf-31ed-4f3b-b4be-f657675842d5"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:28:34.166427 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:28:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f8b95d40-d344-4bcd-930c-8698aad108fc x-openstack-request-id: req-f8b95d40-d344-4bcd-930c-8698aad108fc {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:28:34.166729 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5dc3853b-cccd-4891-b724-3215d5ad9624", "name": "network-vif-deleted", "tag": "d12f82cf-31ed-4f3b-b4be-f657675842d5", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:28:34.166983 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-f8b95d40-d344-4bcd-930c-8698aad108fc {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:28:34.167414 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5dc3853b-cccd-4891-b724-3215d5ad9624', 'name': 'network-vif-deleted', 'tag': 'd12f82cf-31ed-4f3b-b4be-f657675842d5', 'status': 'completed', 'code': 200} Nov 24 11:28:34.258149 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-bd2cc6de-2229-42c9-865d-8559a8fb6259 None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:28:34.461908 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-bd2cc6de-2229-42c9-865d-8559a8fb6259 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:28:34.487852 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd2cc6de-2229-42c9-865d-8559a8fb6259 None None] Checking router: 5ca98cd5-c317-441e-88ed-60cdfa54be52 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:28:34.496143 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bd2cc6de-2229-42c9-865d-8559a8fb6259 None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:28:34.496739 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-bd2cc6de-2229-42c9-865d-8559a8fb6259 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:28:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:28:34.601191 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-bd2cc6de-2229-42c9-865d-8559a8fb6259 None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:28:34.800697 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-bd2cc6de-2229-42c9-865d-8559a8fb6259 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:28:34.951066 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-0ae5a037-dff1-4b12-82df-ef0f69bbb012 req-c00b5526-d4d9-407b-95e0-028d0757db4d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=5dc3853b-cccd-4891-b724-3215d5ad9624 HTTP/1.1" status: 200 len: 210 time: 0.0277610 Nov 24 11:28:34.953254 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bd2cc6de-2229-42c9-865d-8559a8fb6259 None None] The sync data for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi is: [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:28:35.174006 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ebf8a6e-bed9-453d-8dae-3787f211ebe7 None None] New status for floating IP 54303b0b-9e33-4514-95db-75ec43597cf5: DOWN {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:28:36.183701 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-75f31947-ea75-4ea5-b5dd-4dc0c7032677 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1021474358&fields=id&tenant_id=c672667e55bd470cba00102a41b7ea85 HTTP/1.1" status: 200 len: 267 time: 0.0456319 Nov 24 11:28:36.291371 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-664d56bd-d868-4b67-ab69-a64d637ce892 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:36.292718 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-664d56bd-d868-4b67-ab69-a64d637ce892 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 812 time: 0.1023748 Nov 24 11:28:36.307778 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-5f355403-765b-4a49-b782-6f0c7da78f05 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/quotas/c672667e55bd470cba00102a41b7ea85 HTTP/1.1" status: 200 len: 375 time: 0.0092025 Nov 24 11:28:36.358614 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-a224d4eb-dc49-4f0a-8da0-3b8a1b30d18f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0454490 Nov 24 11:28:36.434378 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device d12f82cf-31ed-4f3b-b4be-f657675842d5 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:28:36.454735 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: d12f82cf-31ed-4f3b-b4be-f657675842d5 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:28:36.455079 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device d12f82cf-31ed-4f3b-b4be-f657675842d5 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:28:36.458599 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-f4cb4fa8-34e8-4d8e-a175-164217c3c0d1 service neutron] 10.222.0.76 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864055 Nov 24 11:28:36.545385 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8e42dd81-ac7a-4617-9250-898540284137 service neutron] 10.222.0.76 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0802710 Nov 24 11:28:37.157376 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-c64b4d30-14f5-414c-b1d8-0e0ea40ba47f req-0660f128-c52e-47e4-befc-399340e74567 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 210 time: 0.0263727 Nov 24 11:28:38.258481 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5571309e-0b69-452b-9d03-4aafeb696929 req-c8017b58-a5eb-4161-8d86-94eac52a7bb6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 210 time: 0.0310125 Nov 24 11:28:38.765873 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-72a524e4-2f4b-494d-b77d-13473eabe9e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:39.021869 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-350119dc-dfd9-4a08-9bc8-26a612361209 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:39.023308 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-350119dc-dfd9-4a08-9bc8-26a612361209 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 812 time: 0.1003151 Nov 24 11:28:39.087528 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-ec9db46d-d794-4a40-aba3-d207fcac9d47 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c672667e55bd470cba00102a41b7ea85 HTTP/1.1" status: 200 len: 380 time: 0.0541713 Nov 24 11:28:39.096843 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'port': {'device_id': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'admin_state_up': True, 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'security_groups': ['3995c765-1ba2-40f8-bda1-be920c60a01a']}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:28:39.326171 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Made reservation on behalf of c672667e55bd470cba00102a41b7ea85 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:28:39.330077 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:39.337201 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:39.352691 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-95b27cfb-c6ae-4b55-91bb-80aae7dd4f28 req-41534f4d-f7b4-41b6-bee7-22cc11210224 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 210 time: 0.0261352 Nov 24 11:28:39.459943 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Allocated IP 172.20.0.6 (50c03ad4-9543-459f-a58f-7999897d09ac/7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe/a72a34a1-558b-4db8-a803-4c57d2e1a9b8) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:28:39.594579 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:39.696272 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:39.746050 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Network 50c03ad4-9543-459f-a58f-7999897d09ac is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:28:39.749171 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:28:39.752869 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:28:39.776574 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'Port': ['ID=a72a34a1-558b-4db8-a803-4c57d2e1a9b8,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:28:39.807375 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:39.807982 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:39.929670 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-973a97ff-de06-4ad7-88bf-04cb0f0390d8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8363819 Nov 24 11:28:39.940910 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Request body: {'port': {'device_id': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:28:39.993148 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:40.024764 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-94b2075b-91ae-4aff-aae5-cb67535d1bb6 None None] Provisioning complete for port a72a34a1-558b-4db8-a803-4c57d2e1a9b8 triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:28:40.025409 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-94b2075b-91ae-4aff-aae5-cb67535d1bb6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:40.061814 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-94b2075b-91ae-4aff-aae5-cb67535d1bb6 None None] Port a72a34a1-558b-4db8-a803-4c57d2e1a9b8 cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:28:40.264074 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a72a34a1-558b-4db8-a803-4c57d2e1a9b8 {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:28:40.271434 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:40.283412 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Transition to ACTIVE for port object a72a34a1-558b-4db8-a803-4c57d2e1a9b8 will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:28:40.365928 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:40.436009 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Pushing event updated for resources: {'Port': ['ID=a72a34a1-558b-4db8-a803-4c57d2e1a9b8,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:28:40.485056 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eee561f9-1108-4998-979c-b6c446439e03 req-0f1a3b2c-2388-4733-98f0-7392a9652caf tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:40.486734 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eee561f9-1108-4998-979c-b6c446439e03 req-0f1a3b2c-2388-4733-98f0-7392a9652caf tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 943 time: 0.0613918 Nov 24 11:28:40.491883 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Attempting to bind port a72a34a1-558b-4db8-a803-4c57d2e1a9b8 on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:28:40.492522 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Attempting to bind port a72a34a1-558b-4db8-a803-4c57d2e1a9b8 by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:28:40.493050 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Attempting to bind port a72a34a1-558b-4db8-a803-4c57d2e1a9b8 on network 50c03ad4-9543-459f-a58f-7999897d09ac {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:28:40.498296 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Port a72a34a1-558b-4db8-a803-4c57d2e1a9b8 on network 50c03ad4-9543-459f-a58f-7999897d09ac not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:28:40.498621 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Attempting to bind port a72a34a1-558b-4db8-a803-4c57d2e1a9b8 on network 50c03ad4-9543-459f-a58f-7999897d09ac {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:28:40.503772 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 28, 39), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:28:40.504108 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Checking segment: {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:28:40.504489 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Bound using segment: {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:28:40.505150 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Bound port: a72a34a1-558b-4db8-a803-4c57d2e1a9b8, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:28:40.505516 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:40.542690 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-eee561f9-1108-4998-979c-b6c446439e03 req-9603d22c-b62d-4ee0-9940-8dcd465c16f5 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476847 Nov 24 11:28:40.577588 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] For port a72a34a1-558b-4db8-a803-4c57d2e1a9b8, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:28:40.580668 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] For port a72a34a1-558b-4db8-a803-4c57d2e1a9b8, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=a72a34a1-558b-4db8-a803-4c57d2e1a9b8,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:28:40.675075 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:40.710588 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:40.711195 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:40.712596 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] 10.222.0.86 "PUT /v2.0/ports/a72a34a1-558b-4db8-a803-4c57d2e1a9b8 HTTP/1.1" status: 200 len: 1093 time: 0.7757597 Nov 24 11:28:40.713035 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'tag': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:28:40.715533 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1bd0fb48-095b-4e79-b136-c5a3180d7262" -d '{"events": [{"name": "network-changed", "server_uuid": "6a583cf0-137a-48a6-b542-3b05eef5a5c9", "tag": "a72a34a1-558b-4db8-a803-4c57d2e1a9b8"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:28:40.743877 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8494151f-e849-427e-b24a-bc2afdf8c518 service neutron] Pushing event updated for resources: {'Port': ['ID=a72a34a1-558b-4db8-a803-4c57d2e1a9b8,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:28:40.759136 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:28:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e76b0bd8-17fb-4ce2-8631-6bb7c8778b46 x-openstack-request-id: req-e76b0bd8-17fb-4ce2-8631-6bb7c8778b46 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:28:40.759136 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6a583cf0-137a-48a6-b542-3b05eef5a5c9", "tag": "a72a34a1-558b-4db8-a803-4c57d2e1a9b8", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:28:40.759136 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-e76b0bd8-17fb-4ce2-8631-6bb7c8778b46 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:28:40.759136 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'tag': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'status': 'completed', 'code': 200} Nov 24 11:28:40.822419 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd0fb48-095b-4e79-b136-c5a3180d7262 req-92337da1-4556-4ef0-bb18-5b2f12983280 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:40.824059 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-1bd0fb48-095b-4e79-b136-c5a3180d7262 req-92337da1-4556-4ef0-bb18-5b2f12983280 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 1096 time: 0.0454876 Nov 24 11:28:40.934131 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd0fb48-095b-4e79-b136-c5a3180d7262 req-05346cf7-034c-46f1-8f04-67ae4f13df2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:40.935735 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-1bd0fb48-095b-4e79-b136-c5a3180d7262 req-05346cf7-034c-46f1-8f04-67ae4f13df2b service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=c672667e55bd470cba00102a41b7ea85&shared=False HTTP/1.1" status: 200 len: 914 time: 0.1025414 Nov 24 11:28:41.030798 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd0fb48-095b-4e79-b136-c5a3180d7262 req-0f615ada-d619-494c-8002-bdb8197494a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:41.032239 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-1bd0fb48-095b-4e79-b136-c5a3180d7262 req-0f615ada-d619-494c-8002-bdb8197494a3 service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.0896044 Nov 24 11:28:41.112609 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8ba8e05b-65ad-418c-bf62-e1babd20f2d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:41.114086 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-8ba8e05b-65ad-418c-bf62-e1babd20f2d3 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 1096 time: 0.0444889 Nov 24 11:28:41.157021 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-52140412-7a98-4e48-b502-45f23796685e service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a72a34a1-558b-4db8-a803-4c57d2e1a9b8 HTTP/1.1" status: 200 len: 217 time: 0.0351450 Nov 24 11:28:41.177093 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-21d85a82-813c-453a-b2d6-4f85e1c6d4a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:41.206448 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-6b716b6e-9b1e-4f57-b357-0a021d6098f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:41.207910 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-6b716b6e-9b1e-4f57-b357-0a021d6098f3 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0447257 Nov 24 11:28:41.255426 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-1c7f8c92-193b-4bc1-81a2-ade831549e68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:41.257101 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-1c7f8c92-193b-4bc1-81a2-ade831549e68 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0417359 Nov 24 11:28:41.348058 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-73a0f1e0-3d8f-4da1-82cd-c42c366b6dbc service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831041 Nov 24 11:28:41.440556 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-dd3dbf00-8c5d-4d6a-87b1-bebf05bdd1c7 req-bdad6b61-4405-477c-9bc6-25c87df01cf3 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851982 Nov 24 11:28:41.656949 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36de5614-0e0f-4bb5-92ad-205c68d472aa req-7df0f1e2-a174-474f-8cc4-86bd460bc5f3 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:41.658386 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-36de5614-0e0f-4bb5-92ad-205c68d472aa req-7df0f1e2-a174-474f-8cc4-86bd460bc5f3 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 943 time: 0.0478880 Nov 24 11:28:41.710214 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-36de5614-0e0f-4bb5-92ad-205c68d472aa req-d20697b7-125c-4b70-bdc0-bea597c12202 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443757 Nov 24 11:28:42.468857 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:42.827303 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af17b724-088d-40e1-9a73-5dffed812e50 req-9857d87c-78a5-459e-a94d-93d5df92705d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:42.828786 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-af17b724-088d-40e1-9a73-5dffed812e50 req-9857d87c-78a5-459e-a94d-93d5df92705d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 943 time: 0.0492139 Nov 24 11:28:42.877575 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-af17b724-088d-40e1-9a73-5dffed812e50 req-f7e56f11-3629-4a56-b796-85904ca8d299 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428646 Nov 24 11:28:43.992593 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b12884e-bbe7-42b9-bd64-c8893cc6a598 req-b0f4fc94-b032-4b73-a109-58b854c991c0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:43.994056 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9b12884e-bbe7-42b9-bd64-c8893cc6a598 req-b0f4fc94-b032-4b73-a109-58b854c991c0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 943 time: 0.0482507 Nov 24 11:28:44.042320 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-9b12884e-bbe7-42b9-bd64-c8893cc6a598 req-781219b9-cabc-4235-a4ea-e769b91665a8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423503 Nov 24 11:28:44.072822 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:44.804982 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:45.158860 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-522e2e25-6bf7-4ab5-b36c-3f65b4a28fde req-af7b7a26-03e0-46ff-ac0f-69b203a4580a tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:45.160340 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-522e2e25-6bf7-4ab5-b36c-3f65b4a28fde req-af7b7a26-03e0-46ff-ac0f-69b203a4580a tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 943 time: 0.0515900 Nov 24 11:28:45.208262 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-522e2e25-6bf7-4ab5-b36c-3f65b4a28fde req-45ae7a05-a75d-4eeb-8aa3-f735b7944bba tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415864 Nov 24 11:28:46.320638 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d19cdb64-852a-4fe9-a0c6-93ab14a2dff0 req-7a3792b2-201e-481e-8a12-46b9ade2e385 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:46.322094 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d19cdb64-852a-4fe9-a0c6-93ab14a2dff0 req-7a3792b2-201e-481e-8a12-46b9ade2e385 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 943 time: 0.0474517 Nov 24 11:28:46.370220 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d19cdb64-852a-4fe9-a0c6-93ab14a2dff0 req-f6025248-89dd-4375-a0fa-31799ec967df tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423017 Nov 24 11:28:47.486551 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-096e7e2b-d788-4a27-80e6-c59505b40529 req-a1d8cc3a-53c9-4249-b0ce-5bad71c1ed0f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:47.488032 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-096e7e2b-d788-4a27-80e6-c59505b40529 req-a1d8cc3a-53c9-4249-b0ce-5bad71c1ed0f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 943 time: 0.0518098 Nov 24 11:28:47.535644 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-096e7e2b-d788-4a27-80e6-c59505b40529 req-004cfa74-20a9-484d-806d-91b052211b22 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410335 Nov 24 11:28:48.520516 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device a72a34a1-558b-4db8-a803-4c57d2e1a9b8 details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:28:48.624795 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port a72a34a1-558b-4db8-a803-4c57d2e1a9b8, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=a72a34a1-558b-4db8-a803-4c57d2e1a9b8,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:28:48.637577 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'port_id': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'mac_address': 'fa:16:3e:06:41:16', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1213, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:28:48.666973 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbfa1877-8a94-44dd-ae45-aaa06ca05cae req-042608d0-60c5-4339-88f8-8601e63257cc tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:48.666973 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fbfa1877-8a94-44dd-ae45-aaa06ca05cae req-042608d0-60c5-4339-88f8-8601e63257cc tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 943 time: 0.0556571 Nov 24 11:28:48.681791 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:48.696899 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a72a34a1-558b-4db8-a803-4c57d2e1a9b8 {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:28:48.716957 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port a72a34a1-558b-4db8-a803-4c57d2e1a9b8, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=a72a34a1-558b-4db8-a803-4c57d2e1a9b8,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:28:48.723338 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-fbfa1877-8a94-44dd-ae45-aaa06ca05cae req-410f3772-65c5-4ac9-9ce7-53e81c11096e tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0523176 Nov 24 11:28:48.777563 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:48.835415 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=a72a34a1-558b-4db8-a803-4c57d2e1a9b8,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:28:48.842130 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:48.842485 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:48.842829 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:48.843170 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:48.843539 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:48.843874 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:48.844206 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:48.844542 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:48.844867 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:48.845194 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:48.845518 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:48.845845 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:49.014232 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['a72a34a1-558b-4db8-a803-4c57d2e1a9b8'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:28:49.840686 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d446f343-ae56-4aa0-875c-3d2ed79ffc86 req-3eb4f413-a942-4e2c-97f6-3570ebc48694 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:49.842221 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d446f343-ae56-4aa0-875c-3d2ed79ffc86 req-3eb4f413-a942-4e2c-97f6-3570ebc48694 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 944 time: 0.0490477 Nov 24 11:28:49.894477 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d446f343-ae56-4aa0-875c-3d2ed79ffc86 req-46eb822a-893d-4f26-b4c1-4ec7e9d26348 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464728 Nov 24 11:28:50.534193 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device a72a34a1-558b-4db8-a803-4c57d2e1a9b8 up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:28:50.640030 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port a72a34a1-558b-4db8-a803-4c57d2e1a9b8 completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:28:50.643924 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port a72a34a1-558b-4db8-a803-4c57d2e1a9b8 triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:28:50.644290 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:50.722318 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:50.745255 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:28:50.747501 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b40dac67-4a13-4919-b115-67daad3e0467" -d '{"events": [{"server_uuid": "6a583cf0-137a-48a6-b542-3b05eef5a5c9", "name": "network-vif-plugged", "status": "completed", "tag": "a72a34a1-558b-4db8-a803-4c57d2e1a9b8"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:28:50.759991 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port a72a34a1-558b-4db8-a803-4c57d2e1a9b8, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=a72a34a1-558b-4db8-a803-4c57d2e1a9b8,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:28:50.785040 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:28:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bab696fd-ad71-4d93-a04d-1d50b50b5a87 x-openstack-request-id: req-bab696fd-ad71-4d93-a04d-1d50b50b5a87 {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:28:50.785746 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6a583cf0-137a-48a6-b542-3b05eef5a5c9", "name": "network-vif-plugged", "status": "completed", "tag": "a72a34a1-558b-4db8-a803-4c57d2e1a9b8", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:28:50.785746 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-bab696fd-ad71-4d93-a04d-1d50b50b5a87 {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:28:50.785941 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'code': 200} Nov 24 11:28:50.832890 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:50.881698 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=a72a34a1-558b-4db8-a803-4c57d2e1a9b8,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:28:51.009873 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76d6a7f8-4ca9-4605-891a-e83fe96daad3 req-a4b57c10-aee5-4054-a01c-3bfcdf5b7727 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:51.011377 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-76d6a7f8-4ca9-4605-891a-e83fe96daad3 req-a4b57c10-aee5-4054-a01c-3bfcdf5b7727 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 945 time: 0.0513387 Nov 24 11:28:51.060911 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-76d6a7f8-4ca9-4605-891a-e83fe96daad3 req-2964dbb2-3173-4dd6-8bf6-85de6bc5fb20 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433545 Nov 24 11:28:51.118175 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a18f6ba-9634-4029-8270-7358ebf4160a req-8435a3cc-60a7-4ba6-a9f0-34f2ac25bf5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:51.119661 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4a18f6ba-9634-4029-8270-7358ebf4160a req-8435a3cc-60a7-4ba6-a9f0-34f2ac25bf5a service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 1098 time: 0.0394599 Nov 24 11:28:51.165754 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-4a18f6ba-9634-4029-8270-7358ebf4160a req-715e4335-f8c4-4f63-8d16-625d6584f6cd service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392535 Nov 24 11:28:52.180848 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4334fe8c-a760-4e0b-9b01-5844a4ebfd66 req-89ca6472-2847-435c-be53-4831f6247d7e tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:52.186472 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4334fe8c-a760-4e0b-9b01-5844a4ebfd66 req-89ca6472-2847-435c-be53-4831f6247d7e tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 945 time: 0.0495954 Nov 24 11:28:52.238561 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4334fe8c-a760-4e0b-9b01-5844a4ebfd66 req-d14486a0-daaf-4962-a1d8-dd84467d1e28 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0500386 Nov 24 11:28:53.355401 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8afc6d74-6501-4c26-88b2-0b592d3d224a req-39750331-18f3-40bd-b4d2-99d86d49f4a6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:53.356836 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8afc6d74-6501-4c26-88b2-0b592d3d224a req-39750331-18f3-40bd-b4d2-99d86d49f4a6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 945 time: 0.0518465 Nov 24 11:28:53.405500 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-8afc6d74-6501-4c26-88b2-0b592d3d224a req-e23421f3-4aae-44f3-bc3f-87d620111334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429018 Nov 24 11:28:53.518492 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ea75770-c89a-4674-ab2e-7e107a4d50ce req-f6b3e9a6-8b78-4727-b88b-d98f3a76cad7 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:53.520006 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ea75770-c89a-4674-ab2e-7e107a4d50ce req-f6b3e9a6-8b78-4727-b88b-d98f3a76cad7 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 945 time: 0.0492203 Nov 24 11:28:53.581272 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-4ea75770-c89a-4674-ab2e-7e107a4d50ce req-51945955-0522-41f0-a652-92046614bf15 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0550740 Nov 24 11:28:53.604657 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35622) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:28:53.642225 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ad1d406-6fdf-47b9-aaaf-614937f7e28c tempest-TestVolumeBootPattern-1409714024 tempest-TestVolumeBootPattern-1409714024-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:53.643728 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-9ad1d406-6fdf-47b9-aaaf-614937f7e28c tempest-TestVolumeBootPattern-1409714024 tempest-TestVolumeBootPattern-1409714024-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 1093 time: 0.0381248 Nov 24 11:28:53.646363 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35624) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:28:53.650962 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'floatingip': {'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'port_id': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address': '172.20.0.6'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:28:53.736963 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:53.833574 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:53.940491 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Allocated IP 172.27.3.155 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/af6e233e-3ac5-4f07-8294-8e6dd705a5dd) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:28:54.040729 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:54.137138 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:54.183230 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:28:54.186259 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:28:54.189758 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:28:54.196302 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'Port': ['ID=af6e233e-3ac5-4f07-8294-8e6dd705a5dd,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:28:54.228480 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:54.228833 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:54.229183 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:54.229520 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:54.229853 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:54.230185 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:54.230520 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:54.230847 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:54.231177 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:54.231520 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:54.231843 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:54.232227 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:28:54.556622 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:54.679606 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:54.821939 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for port, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:54.885242 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8699083'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:54.955381 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'Port': ['ID=af6e233e-3ac5-4f07-8294-8e6dd705a5dd,revision_number=2']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:28:54.965304 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:55.302000 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.l3_db [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Floating IP 8d67be57-0bf5-49d4-b658-ed2d3e637117 associated. External IP: 172.27.3.155, port: a72a34a1-558b-4db8-a803-4c57d2e1a9b8. Nov 24 11:28:55.507446 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Router 5ca98cd5-c317-441e-88ed-60cdfa54be52 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:28:55.609090 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:28:55.618858 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef0aba97-5268-408b-a6f0-86eb011130d9 None None] Sync routers for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:28:55.628051 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef0aba97-5268-408b-a6f0-86eb011130d9 None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:28:55.628643 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-ef0aba97-5268-408b-a6f0-86eb011130d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:28:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:28:55.682281 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:28:55.711254 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-5a776814-f97f-4da3-b027-a96f32d13cc8 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.0633652 Nov 24 11:28:55.711844 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'tag': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:28:55.714360 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-690d6b04-cc11-4f9c-a949-fd1e7198a738" -d '{"events": [{"name": "network-changed", "server_uuid": "6a583cf0-137a-48a6-b542-3b05eef5a5c9", "tag": "a72a34a1-558b-4db8-a803-4c57d2e1a9b8"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:28:55.735501 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-ef0aba97-5268-408b-a6f0-86eb011130d9 None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:28:55.753441 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:28:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8e9f11f-d379-4028-8dda-9ac7005292b0 x-openstack-request-id: req-a8e9f11f-d379-4028-8dda-9ac7005292b0 {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:28:55.753742 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6a583cf0-137a-48a6-b542-3b05eef5a5c9", "tag": "a72a34a1-558b-4db8-a803-4c57d2e1a9b8", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:28:55.753997 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-a8e9f11f-d379-4028-8dda-9ac7005292b0 {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:28:55.754399 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'tag': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'status': 'completed', 'code': 200} Nov 24 11:28:55.815103 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690d6b04-cc11-4f9c-a949-fd1e7198a738 req-e91af5f6-9f99-44ef-8816-85d36766d750 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:55.816624 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-690d6b04-cc11-4f9c-a949-fd1e7198a738 req-e91af5f6-9f99-44ef-8816-85d36766d750 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 1098 time: 0.0404816 Nov 24 11:28:55.910602 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690d6b04-cc11-4f9c-a949-fd1e7198a738 req-c5235b52-4724-4039-80ad-f759481b2e41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:55.912034 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-690d6b04-cc11-4f9c-a949-fd1e7198a738 req-c5235b52-4724-4039-80ad-f759481b2e41 service neutron] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 914 time: 0.0888615 Nov 24 11:28:55.963056 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-ef0aba97-5268-408b-a6f0-86eb011130d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '8d67be57-0bf5-49d4-b658-ed2d3e637117', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.155', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 700, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:06:41:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:28:54Z', 'updated_at': '2021-11-24T11:28:54Z', 'revision_number': 0, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:28:55.979058 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-690d6b04-cc11-4f9c-a949-fd1e7198a738 req-25fec0f5-dabc-48a2-ae12-09a4621e9401 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a72a34a1-558b-4db8-a803-4c57d2e1a9b8 HTTP/1.1" status: 200 len: 999 time: 0.0599840 Nov 24 11:28:55.989422 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef0aba97-5268-408b-a6f0-86eb011130d9 None None] Checking router: 5ca98cd5-c317-441e-88ed-60cdfa54be52 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:28:55.997676 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef0aba97-5268-408b-a6f0-86eb011130d9 None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:28:55.998357 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-ef0aba97-5268-408b-a6f0-86eb011130d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:28:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:28:56.031817 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690d6b04-cc11-4f9c-a949-fd1e7198a738 req-c808bf48-dc27-4e64-9b52-70451ccf55c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:56.033257 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-690d6b04-cc11-4f9c-a949-fd1e7198a738 req-c808bf48-dc27-4e64-9b52-70451ccf55c3 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0472479 Nov 24 11:28:56.078800 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-690d6b04-cc11-4f9c-a949-fd1e7198a738 req-bcb049b8-7cb4-4cd2-97d1-fbcb2b94b37d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:28:56.080355 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-690d6b04-cc11-4f9c-a949-fd1e7198a738 req-bcb049b8-7cb4-4cd2-97d1-fbcb2b94b37d service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0393519 Nov 24 11:28:56.107180 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-ef0aba97-5268-408b-a6f0-86eb011130d9 None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:28:56.169560 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-690d6b04-cc11-4f9c-a949-fd1e7198a738 req-c432e9b0-0dd8-45ab-b896-971691834ee7 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823607 Nov 24 11:28:56.265004 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-690d6b04-cc11-4f9c-a949-fd1e7198a738 req-68588245-7a14-435e-be5c-58237e2082e6 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882804 Nov 24 11:28:56.330431 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-ef0aba97-5268-408b-a6f0-86eb011130d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '8d67be57-0bf5-49d4-b658-ed2d3e637117', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.155', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 700, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:06:41:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:28:54Z', 'updated_at': '2021-11-24T11:28:54Z', 'revision_number': 0, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:28:56.356880 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef0aba97-5268-408b-a6f0-86eb011130d9 None None] The sync data for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi is: [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '8d67be57-0bf5-49d4-b658-ed2d3e637117', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.155', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 700, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:06:41:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:28:54Z', 'updated_at': '2021-11-24T11:28:54Z', 'revision_number': 0, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:28:56.544659 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b7bb8faa-900c-4b9a-8762-3941d83b59fa None None] New status for floating IP 8d67be57-0bf5-49d4-b658-ed2d3e637117: ACTIVE {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:29:08.759611 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d0da2889-59aa-429c-9879-5ec67472cfc1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:29:09.064475 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:29:09.336207 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:29:11.188132 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-1a90826d-296a-4547-9183-52ea034083bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:29:12.489220 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:29:14.078453 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:29:14.832436 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:29:21.709794 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01a54a08-bf47-4372-b1c1-81f7e9951499 req-42032b93-b565-4056-9e87-07bca3565256 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0384672 Nov 24 11:29:21.795417 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a54a08-bf47-4372-b1c1-81f7e9951499 req-4d6719b5-be6c-498e-ad17-ca7d196dcd32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:29:21.796883 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01a54a08-bf47-4372-b1c1-81f7e9951499 req-4d6719b5-be6c-498e-ad17-ca7d196dcd32 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 1098 time: 0.0444074 Nov 24 11:29:21.896380 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a54a08-bf47-4372-b1c1-81f7e9951499 req-443d2d05-2229-4b78-8f82-9c76e56e0d02 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:29:21.897801 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01a54a08-bf47-4372-b1c1-81f7e9951499 req-443d2d05-2229-4b78-8f82-9c76e56e0d02 service neutron] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 914 time: 0.0821545 Nov 24 11:29:21.965678 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01a54a08-bf47-4372-b1c1-81f7e9951499 req-389c4b44-fd76-4504-a49e-ce6aed3c9cfb service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a72a34a1-558b-4db8-a803-4c57d2e1a9b8 HTTP/1.1" status: 200 len: 1001 time: 0.0606227 Nov 24 11:29:22.013737 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a54a08-bf47-4372-b1c1-81f7e9951499 req-dde434e1-ff4f-4697-87c4-0807a961c379 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:29:22.015118 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01a54a08-bf47-4372-b1c1-81f7e9951499 req-dde434e1-ff4f-4697-87c4-0807a961c379 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0422029 Nov 24 11:29:22.059618 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a54a08-bf47-4372-b1c1-81f7e9951499 req-a2f8c7b5-4d18-453d-a67c-4bd6c7118d23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:29:22.061061 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01a54a08-bf47-4372-b1c1-81f7e9951499 req-a2f8c7b5-4d18-453d-a67c-4bd6c7118d23 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0385566 Nov 24 11:29:22.152639 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01a54a08-bf47-4372-b1c1-81f7e9951499 req-a0563dd8-c9db-4f38-89f9-c2388b714c49 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841258 Nov 24 11:29:22.242637 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-01a54a08-bf47-4372-b1c1-81f7e9951499 req-c43a7270-6ff8-425f-aff7-62c485c3b7dc service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833175 Nov 24 11:29:38.764860 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d4ee8b88-20d8-40fe-bdca-1fd57a9650c9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:29:39.313442 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:29:41.164647 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-2125f996-b463-4a1f-9420-e0996d070eab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:29:42.518791 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:29:44.118815 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:29:44.810480 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:29:46.062799 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:30:08.747129 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c1e42316-3180-4eb1-807d-29e0314f3547 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:09.306909 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:11.151698 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-97c79c74-0854-4363-9f2e-b0cb3ef9686c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:12.489652 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:14.079176 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:14.831583 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:22.716189 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7e53fb44-bc44-4808-8f3c-82d40abe1e98 req-4e9c2053-0199-4dd1-affb-d675e5bddca5 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0432818 Nov 24 11:30:22.801376 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e53fb44-bc44-4808-8f3c-82d40abe1e98 req-1d3801ce-601c-48bb-91c9-2fddec72910e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:22.802905 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7e53fb44-bc44-4808-8f3c-82d40abe1e98 req-1d3801ce-601c-48bb-91c9-2fddec72910e service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 1098 time: 0.0408235 Nov 24 11:30:22.906143 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e53fb44-bc44-4808-8f3c-82d40abe1e98 req-4c5a0d2e-0c82-4a64-8fa0-7613dc246321 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:22.907603 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7e53fb44-bc44-4808-8f3c-82d40abe1e98 req-4c5a0d2e-0c82-4a64-8fa0-7613dc246321 service neutron] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 914 time: 0.0838361 Nov 24 11:30:22.977937 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7e53fb44-bc44-4808-8f3c-82d40abe1e98 req-9985a130-1bba-4e04-97d5-bbd1dc1f5c6d service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a72a34a1-558b-4db8-a803-4c57d2e1a9b8 HTTP/1.1" status: 200 len: 1001 time: 0.0616596 Nov 24 11:30:23.028275 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e53fb44-bc44-4808-8f3c-82d40abe1e98 req-faaf20ee-8648-492d-a487-7aecb627818f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:23.029681 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7e53fb44-bc44-4808-8f3c-82d40abe1e98 req-faaf20ee-8648-492d-a487-7aecb627818f service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0434537 Nov 24 11:30:23.062028 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:30:23.075864 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e53fb44-bc44-4808-8f3c-82d40abe1e98 req-e10e708d-8461-4d88-85f4-f6908fc2b115 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:23.077341 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7e53fb44-bc44-4808-8f3c-82d40abe1e98 req-e10e708d-8461-4d88-85f4-f6908fc2b115 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0392992 Nov 24 11:30:23.169384 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7e53fb44-bc44-4808-8f3c-82d40abe1e98 req-cbbcd3e1-bfd7-4638-9217-43047d25c7c4 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839190 Nov 24 11:30:23.259241 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-7e53fb44-bc44-4808-8f3c-82d40abe1e98 req-8c1f2f6b-2229-445b-9173-fd0de44065e6 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809512 Nov 24 11:30:24.402725 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-f519bb01-df7c-4291-aaf9-9f406aa9a60e tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1021474358&fields=id&tenant_id=c672667e55bd470cba00102a41b7ea85 HTTP/1.1" status: 200 len: 267 time: 0.0436649 Nov 24 11:30:24.508634 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-e8166f1f-f8f6-46c6-bc23-f9cfd78a1e87 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:24.510066 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-e8166f1f-f8f6-46c6-bc23-f9cfd78a1e87 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 812 time: 0.1001115 Nov 24 11:30:24.524546 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-a426e3e2-4248-4498-bb67-7194e6a33619 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/quotas/c672667e55bd470cba00102a41b7ea85 HTTP/1.1" status: 200 len: 375 time: 0.0087671 Nov 24 11:30:24.580097 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-59e88123-d741-40a7-b492-f4d6d590cfbf tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0504241 Nov 24 11:30:24.740143 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-c97848ad-a807-49b4-bd72-647080b019e2 service neutron] 10.222.0.76 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1476831 Nov 24 11:30:24.832941 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-f8ef1d2d-1dba-44fb-8fb3-a8ef9b282ee8 service neutron] 10.222.0.76 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866146 Nov 24 11:30:25.444047 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a8982e7d-5879-4cda-ac2f-0636f451f142 req-c5b511b7-a5e5-4739-9bae-36c9727d4a08 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 210 time: 0.0943420 Nov 24 11:30:26.546149 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f9c07262-37f0-4e79-90f8-e5d025e781bb req-ace416aa-a317-4b1b-8a4f-38f586077305 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 210 time: 0.0261509 Nov 24 11:30:27.152069 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-149df543-55f7-402b-8df1-887a5081a7ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:27.153563 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-149df543-55f7-402b-8df1-887a5081a7ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 812 time: 0.1054344 Nov 24 11:30:27.218890 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6e772dc7-1186-42eb-b48b-1458efaf4cdc tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c672667e55bd470cba00102a41b7ea85 HTTP/1.1" status: 200 len: 380 time: 0.0550337 Nov 24 11:30:27.228531 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'port': {'device_id': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'admin_state_up': True, 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'security_groups': ['3995c765-1ba2-40f8-bda1-be920c60a01a']}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:30:27.426403 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Made reservation on behalf of c672667e55bd470cba00102a41b7ea85 for: {'port': 1} {{(pid=103243) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 24 11:30:27.429993 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:27.551434 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_common [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Allocated IP 172.20.0.7 (50c03ad4-9543-459f-a58f-7999897d09ac/7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe/9c98cf79-3e0e-4754-bd5a-7f65892246ab) {{(pid=103243) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:30:27.658852 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-7a646cdf-b2b4-45d2-b3ff-0ba689a34137 req-d0680e00-fbd4-4d61-b15d-8a1840a74c65 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 210 time: 0.0325332 Nov 24 11:30:27.690997 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for port, precommit_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:27.792818 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_create {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:27.838594 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Network 50c03ad4-9543-459f-a58f-7999897d09ac is already hosted by enough agents. {{(pid=103243) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:30:27.841810 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.base_scheduler [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Resources bound (agent type, host, resource id): {{(pid=103243) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:30:27.845630 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Received port after_create {{(pid=103243) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:30:27.854529 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'Port': ['ID=9c98cf79-3e0e-4754-bd5a-7f65892246ab,revision_number=1']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:30:27.889411 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:27.889760 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:27.890104 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:27.890465 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:27.890826 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:27.891201 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:27.891566 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:27.891900 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:27.892229 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:27.893091 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:27.893793 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:27.894340 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:27.919109 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:27.919958 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:27.989703 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-6c0a89d0-d269-4526-90a6-98b05bd4fb69 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7650354 Nov 24 11:30:28.001513 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.v2.base [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Request body: {'port': {'device_id': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80403'}} {{(pid=103243) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:30:28.056440 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:28.060397 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-db09f8b2-71b3-41e1-b23c-89d9945cf448 None None] Provisioning complete for port 9c98cf79-3e0e-4754-bd5a-7f65892246ab triggered by entity DHCP. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:30:28.060932 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-db09f8b2-71b3-41e1-b23c-89d9945cf448 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:28.096405 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-db09f8b2-71b3-41e1-b23c-89d9945cf448 None None] Port 9c98cf79-3e0e-4754-bd5a-7f65892246ab cannot update to ACTIVE because it is not bound. {{(pid=103245) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 24 11:30:28.319846 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9c98cf79-3e0e-4754-bd5a-7f65892246ab {{(pid=103243) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:30:28.321234 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Publish callbacks [] for port, precommit_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:28.333920 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.provisioning_blocks [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Transition to ACTIVE for port object 9c98cf79-3e0e-4754-bd5a-7f65892246ab will not be triggered until provisioned by entity L2. {{(pid=103243) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 24 11:30:28.449416 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:28.518031 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Pushing event updated for resources: {'Port': ['ID=9c98cf79-3e0e-4754-bd5a-7f65892246ab,revision_number=2']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:30:28.570511 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Attempting to bind port 9c98cf79-3e0e-4754-bd5a-7f65892246ab on host hv-cinder-80403 for vnic_type normal with profile {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 24 11:30:28.570759 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Attempting to bind port 9c98cf79-3e0e-4754-bd5a-7f65892246ab by drivers openvswitch,hyperv on host hv-cinder-80403 at level 0 using segments [{'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 24 11:30:28.571083 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Attempting to bind port 9c98cf79-3e0e-4754-bd5a-7f65892246ab on network 50c03ad4-9543-459f-a58f-7999897d09ac {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:30:28.575476 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Port 9c98cf79-3e0e-4754-bd5a-7f65892246ab on network 50c03ad4-9543-459f-a58f-7999897d09ac not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80403 {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 24 11:30:28.575797 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Attempting to bind port 9c98cf79-3e0e-4754-bd5a-7f65892246ab on network 50c03ad4-9543-459f-a58f-7999897d09ac {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 24 11:30:28.581169 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Checking agent: {'id': '2a504135-71cf-45f0-af99-95139dfebb66', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80403', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'started_at': datetime.datetime(2021, 11, 24, 11, 13, 9), 'heartbeat_timestamp': datetime.datetime(2021, 11, 24, 11, 30, 9), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 24 11:30:28.581503 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Checking segment: {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=103243) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 24 11:30:28.581883 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Bound using segment: {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'} {{(pid=103243) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 24 11:30:28.582306 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.managers [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Bound port: 9c98cf79-3e0e-4754-bd5a-7f65892246ab, host: hv-cinder-80403, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1213, 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac'}}] {{(pid=103243) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 24 11:30:28.582664 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:28.647490 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] For port 9c98cf79-3e0e-4754-bd5a-7f65892246ab, host hv-cinder-80403, cleared binding levels {{(pid=103243) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 24 11:30:28.655240 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] For port 9c98cf79-3e0e-4754-bd5a-7f65892246ab, host hv-cinder-80403, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=9c98cf79-3e0e-4754-bd5a-7f65892246ab,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103243) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 24 11:30:28.747183 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8721912'] for port, after_update {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:28.767429 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1f22f60-c365-41ad-a4fa-368817e673fb req-30ffa2c8-2c76-44f3-a65e-4210eaa7dc2b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:28.772883 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f1f22f60-c365-41ad-a4fa-368817e673fb req-30ffa2c8-2c76-44f3-a65e-4210eaa7dc2b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 943 time: 0.0512757 Nov 24 11:30:28.784124 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:28.784877 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:28.786624 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] 10.222.0.86 "PUT /v2.0/ports/9c98cf79-3e0e-4754-bd5a-7f65892246ab HTTP/1.1" status: 200 len: 1093 time: 0.7888434 Nov 24 11:30:28.786624 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'tag': '9c98cf79-3e0e-4754-bd5a-7f65892246ab'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:30:28.788807 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e117372-7adb-4dea-884e-b17d766c8ed3" -d '{"events": [{"name": "network-changed", "server_uuid": "d36786aa-8725-4b52-9ee7-19d391c64c93", "tag": "9c98cf79-3e0e-4754-bd5a-7f65892246ab"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:30:28.818658 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac5609b1-d32b-4099-a219-34f69bd9ab69 service neutron] Pushing event updated for resources: {'Port': ['ID=9c98cf79-3e0e-4754-bd5a-7f65892246ab,revision_number=3']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:30:28.845996 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f1f22f60-c365-41ad-a4fa-368817e673fb req-9129ee3d-76dd-4355-8bcd-fca2fce316d7 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0630639 Nov 24 11:30:28.846440 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:30:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cea4c916-bba0-42de-b961-488e0c4c170e x-openstack-request-id: req-cea4c916-bba0-42de-b961-488e0c4c170e {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:30:28.846440 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d36786aa-8725-4b52-9ee7-19d391c64c93", "tag": "9c98cf79-3e0e-4754-bd5a-7f65892246ab", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:30:28.846440 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-cea4c916-bba0-42de-b961-488e0c4c170e {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:30:28.846440 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'tag': '9c98cf79-3e0e-4754-bd5a-7f65892246ab', 'status': 'completed', 'code': 200} Nov 24 11:30:28.914486 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e117372-7adb-4dea-884e-b17d766c8ed3 req-38f8e382-d7a3-4816-a15a-0ce4020f609a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:28.916035 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e117372-7adb-4dea-884e-b17d766c8ed3 req-38f8e382-d7a3-4816-a15a-0ce4020f609a service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 1096 time: 0.0447571 Nov 24 11:30:29.022924 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e117372-7adb-4dea-884e-b17d766c8ed3 req-2d49e638-3c46-477a-a89b-790517e09e45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:29.024432 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e117372-7adb-4dea-884e-b17d766c8ed3 req-2d49e638-3c46-477a-a89b-790517e09e45 service neutron] 10.222.0.86 "GET /v2.0/networks?tenant_id=c672667e55bd470cba00102a41b7ea85&shared=False HTTP/1.1" status: 200 len: 914 time: 0.0991533 Nov 24 11:30:29.120080 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e117372-7adb-4dea-884e-b17d766c8ed3 req-f636eed6-350c-4cb9-9111-208f9b59db76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:29.121549 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-9e117372-7adb-4dea-884e-b17d766c8ed3 req-f636eed6-350c-4cb9-9111-208f9b59db76 service neutron] 10.222.0.86 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.0898819 Nov 24 11:30:29.198881 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-16bfd95e-14cd-4955-a26e-4d0cc595e0cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:29.200389 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-16bfd95e-14cd-4955-a26e-4d0cc595e0cc service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 1096 time: 0.0412443 Nov 24 11:30:29.245008 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-49f529a9-1050-439f-9e03-a088f64b6c1b service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9c98cf79-3e0e-4754-bd5a-7f65892246ab HTTP/1.1" status: 200 len: 217 time: 0.0363014 Nov 24 11:30:29.294810 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-4ca77d85-02a7-4bf3-856c-21f8bfc81402 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:29.296251 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-4ca77d85-02a7-4bf3-856c-21f8bfc81402 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0445542 Nov 24 11:30:29.340922 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-8efb3034-03a0-415e-b327-8f58c525278f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:29.342422 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-8efb3034-03a0-415e-b327-8f58c525278f service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0395610 Nov 24 11:30:29.433538 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-010bef8c-930d-48f1-adf4-04e8502399be service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840456 Nov 24 11:30:29.523673 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-5bf43acc-9e6d-47ad-8d50-f6e5365315cf req-8e8c8aa5-cc93-4f55-9032-cd66cd678b16 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817327 Nov 24 11:30:29.957326 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b19ee4b-6a3c-45a3-add0-e16c293f132d req-206fcf91-40c1-4074-8aaf-73ef4c71ee1b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:29.958772 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2b19ee4b-6a3c-45a3-add0-e16c293f132d req-206fcf91-40c1-4074-8aaf-73ef4c71ee1b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 943 time: 0.0484266 Nov 24 11:30:30.007815 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2b19ee4b-6a3c-45a3-add0-e16c293f132d req-6a4998ca-0701-44d9-bfac-ecaed39b21e9 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431390 Nov 24 11:30:31.120941 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e4896fd-fe4e-47f5-b302-4ebbf14fb7c3 req-01c22ce3-bd09-405c-a283-57eaf12ca9b9 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:31.122404 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2e4896fd-fe4e-47f5-b302-4ebbf14fb7c3 req-01c22ce3-bd09-405c-a283-57eaf12ca9b9 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 943 time: 0.0485704 Nov 24 11:30:31.171074 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-2e4896fd-fe4e-47f5-b302-4ebbf14fb7c3 req-568fdf37-a2e2-43c9-a1f0-8770f760bcab tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421569 Nov 24 11:30:32.290533 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54b34e79-2669-4857-a2a6-85f8b55d9d96 req-6f0bd73c-2da2-4ec8-84a6-9fe6531ad665 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:32.292052 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-54b34e79-2669-4857-a2a6-85f8b55d9d96 req-6f0bd73c-2da2-4ec8-84a6-9fe6531ad665 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 943 time: 0.0521731 Nov 24 11:30:32.340563 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-54b34e79-2669-4857-a2a6-85f8b55d9d96 req-9a893db7-5595-4099-9f07-91fa6228d5a0 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421300 Nov 24 11:30:33.454269 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e7c7bc-e707-4222-8104-976555937cbd req-d4fab668-1840-48ef-bf9f-b07f15ef32d6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:33.455727 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-68e7c7bc-e707-4222-8104-976555937cbd req-d4fab668-1840-48ef-bf9f-b07f15ef32d6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 943 time: 0.0481222 Nov 24 11:30:33.504124 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-68e7c7bc-e707-4222-8104-976555937cbd req-4f69be37-ce0d-4cd8-8db0-82310e62c3cb tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419877 Nov 24 11:30:34.622138 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fe813db-bc4c-4fa9-a80e-332274ae8345 req-f3a47432-86fb-4f8f-9c74-97f28c43597c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:34.623617 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3fe813db-bc4c-4fa9-a80e-332274ae8345 req-f3a47432-86fb-4f8f-9c74-97f28c43597c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 943 time: 0.0532012 Nov 24 11:30:34.671479 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3fe813db-bc4c-4fa9-a80e-332274ae8345 req-6298fe8f-6baa-4b92-b76b-a449e8cd4f81 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419736 Nov 24 11:30:35.787400 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-773fd183-3c4d-4898-ac1a-14a4a9958d3c req-598f886f-278a-41a3-bfb3-e8c68e335d06 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:35.788908 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-773fd183-3c4d-4898-ac1a-14a4a9958d3c req-598f886f-278a-41a3-bfb3-e8c68e335d06 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 943 time: 0.0494721 Nov 24 11:30:35.838405 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-773fd183-3c4d-4898-ac1a-14a4a9958d3c req-f7e4769a-2251-44c4-bbf1-edeec15aad20 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433848 Nov 24 11:30:36.953610 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7b22fe0-1b58-4875-85bf-a4c2c654a4f2 req-0713dae3-eeaf-43ea-89ce-d7a224ba358f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:36.955053 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a7b22fe0-1b58-4875-85bf-a4c2c654a4f2 req-0713dae3-eeaf-43ea-89ce-d7a224ba358f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 943 time: 0.0484297 Nov 24 11:30:37.007733 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-a7b22fe0-1b58-4875-85bf-a4c2c654a4f2 req-08b12fc5-b42a-4f87-92ce-42c6dfbd50ff tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465667 Nov 24 11:30:37.059622 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 9c98cf79-3e0e-4754-bd5a-7f65892246ab details requested by agent hyperv_hv-cinder-80403 with host hv-cinder-80403 {{(pid=103245) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 24 11:30:37.158428 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 9c98cf79-3e0e-4754-bd5a-7f65892246ab, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=9c98cf79-3e0e-4754-bd5a-7f65892246ab,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:30:37.170105 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Returning: {'device': '9c98cf79-3e0e-4754-bd5a-7f65892246ab', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'port_id': '9c98cf79-3e0e-4754-bd5a-7f65892246ab', 'mac_address': 'fa:16:3e:c5:68:bf', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1213, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=103245) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 24 11:30:37.204934 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:37.218287 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9c98cf79-3e0e-4754-bd5a-7f65892246ab {{(pid=103245) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 24 11:30:37.237777 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 9c98cf79-3e0e-4754-bd5a-7f65892246ab, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=9c98cf79-3e0e-4754-bd5a-7f65892246ab,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:30:37.306416 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:37.353236 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=9c98cf79-3e0e-4754-bd5a-7f65892246ab,revision_number=4']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:30:37.360114 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:37.360464 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:37.360804 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:37.361136 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:37.361467 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:37.361796 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:37.362124 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:37.362485 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:37.362897 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:37.363329 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:37.363661 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:37.363985 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:37.530451 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] get_ports_and_sgs() called for port_ids ['9c98cf79-3e0e-4754-bd5a-7f65892246ab'] {{(pid=103245) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 24 11:30:38.121520 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4139871-5a7f-4d28-b9ab-0b0cad816417 req-c8d699d7-a229-47e7-acd2-13351b012a78 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:38.122970 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b4139871-5a7f-4d28-b9ab-0b0cad816417 req-c8d699d7-a229-47e7-acd2-13351b012a78 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 944 time: 0.0492759 Nov 24 11:30:38.172410 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-b4139871-5a7f-4d28-b9ab-0b0cad816417 req-625c58dc-edc6-4fdf-a34f-d04e3c2d79cf tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429008 Nov 24 11:30:38.786685 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-115760ca-2fa1-4aba-b671-b1322eeebe7b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:39.073422 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 9c98cf79-3e0e-4754-bd5a-7f65892246ab up at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 24 11:30:39.292714 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41865805-52b8-47c4-9ada-31ede49eefee req-293f6ff8-cdf5-468e-9ba7-1fbf983d55ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:39.294211 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-41865805-52b8-47c4-9ada-31ede49eefee req-293f6ff8-cdf5-468e-9ba7-1fbf983d55ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 944 time: 0.0530498 Nov 24 11:30:39.323351 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning for port 9c98cf79-3e0e-4754-bd5a-7f65892246ab completed by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 24 11:30:39.334152 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.provisioning_blocks [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Provisioning complete for port 9c98cf79-3e0e-4754-bd5a-7f65892246ab triggered by entity L2. {{(pid=103245) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 24 11:30:39.334152 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-8282761'] for port, provisioning_complete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:39.343977 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-41865805-52b8-47c4-9ada-31ede49eefee req-bf8a1cc1-f435-4d88-a186-99808433d23d tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437605 Nov 24 11:30:39.352896 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:39.405686 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:39.430183 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c98cf79-3e0e-4754-bd5a-7f65892246ab'}] {{(pid=103245) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:30:39.438446 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e4e094703c60820ad13322cc675830ad58d810d39c487882d2aaaa29e8adec41" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7f7e661-82dc-4c92-a83c-b8dd407cd051" -d '{"events": [{"server_uuid": "d36786aa-8725-4b52-9ee7-19d391c64c93", "name": "network-vif-plugged", "status": "completed", "tag": "9c98cf79-3e0e-4754-bd5a-7f65892246ab"}]}' {{(pid=103245) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:30:39.445486 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] For port 9c98cf79-3e0e-4754-bd5a-7f65892246ab, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=9c98cf79-3e0e-4754-bd5a-7f65892246ab,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:30:39.471215 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:30:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15f4a77d-3039-4ba0-bb88-9682de6994af x-openstack-request-id: req-15f4a77d-3039-4ba0-bb88-9682de6994af {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:30:39.471528 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d36786aa-8725-4b52-9ee7-19d391c64c93", "name": "network-vif-plugged", "status": "completed", "tag": "9c98cf79-3e0e-4754-bd5a-7f65892246ab", "code": 200}]} {{(pid=103245) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:30:39.471794 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-15f4a77d-3039-4ba0-bb88-9682de6994af {{(pid=103245) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:30:39.472189 dv-cinder-804035-18-iscsi neutron-server[103245]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9c98cf79-3e0e-4754-bd5a-7f65892246ab', 'code': 200} Nov 24 11:30:39.512526 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206'] for port, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:39.560656 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Pushing event updated for resources: {'Port': ['ID=9c98cf79-3e0e-4754-bd5a-7f65892246ab,revision_number=5']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:30:39.809410 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-444b9f52-b0f6-4804-a1b5-27c19fcc5582 req-aa58c6df-c749-4130-a843-195b99afd3c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:39.810871 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-444b9f52-b0f6-4804-a1b5-27c19fcc5582 req-aa58c6df-c749-4130-a843-195b99afd3c2 service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 1098 time: 0.0443175 Nov 24 11:30:39.858432 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-444b9f52-b0f6-4804-a1b5-27c19fcc5582 req-c565b764-dc13-49a4-a01f-3d7b6a0ef841 service neutron] 10.222.0.86 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385478 Nov 24 11:30:40.461925 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf80052-f39e-4796-81f8-3d914b670533 req-f704f06e-ad7c-480f-baf2-1ca4bac42c12 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:40.463404 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-edf80052-f39e-4796-81f8-3d914b670533 req-f704f06e-ad7c-480f-baf2-1ca4bac42c12 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 945 time: 0.0520802 Nov 24 11:30:40.512002 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-edf80052-f39e-4796-81f8-3d914b670533 req-fea842c0-1901-4e63-a0e0-ee7b91e2e347 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425010 Nov 24 11:30:41.198159 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-3e77bcd5-09e8-4f92-bc32-67f481c82883 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:41.632415 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17eb6c9-eb56-461f-87ef-5d13bdf5095a req-0ae43da1-c806-4660-ab2a-1c322ee2c33c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:41.633916 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e17eb6c9-eb56-461f-87ef-5d13bdf5095a req-0ae43da1-c806-4660-ab2a-1c322ee2c33c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 945 time: 0.0531595 Nov 24 11:30:41.685340 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e17eb6c9-eb56-461f-87ef-5d13bdf5095a req-743a47b6-b4a1-46e5-8ff3-942d06b96cb9 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454562 Nov 24 11:30:41.803691 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a38726a-573c-49ca-974f-ed5c3299d9cc req-184fabc0-0323-4771-bb85-3e51915bd00f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:41.806398 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3a38726a-573c-49ca-974f-ed5c3299d9cc req-184fabc0-0323-4771-bb85-3e51915bd00f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 945 time: 0.0502832 Nov 24 11:30:41.860375 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-3a38726a-573c-49ca-974f-ed5c3299d9cc req-44d32ed4-f4f2-420d-99bf-0c341cf497bf tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490503 Nov 24 11:30:41.882704 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35752) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:30:41.923030 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-88d63b93-18e0-447a-85b8-6473b64d9dac tempest-TestVolumeBootPattern-1409714024 tempest-TestVolumeBootPattern-1409714024-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:41.927438 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-88d63b93-18e0-447a-85b8-6473b64d9dac tempest-TestVolumeBootPattern-1409714024 tempest-TestVolumeBootPattern-1409714024-project-admin] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 1093 time: 0.0408101 Nov 24 11:30:41.927604 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35754) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:30:41.931813 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.v2.base [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Request body: {'floatingip': {'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'port_id': '9c98cf79-3e0e-4754-bd5a-7f65892246ab', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address': '172.20.0.7'}} {{(pid=103244) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 24 11:30:42.031441 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:42.134123 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:42.237814 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_common [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Allocated IP 172.27.3.151 (fa6231d1-a629-42bc-a091-20035dee3542/741c8451-f41e-4184-b25a-74d54247c82b/a4311927-ef64-4171-8a6f-589311dd49fd) {{(pid=103244) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 24 11:30:42.346537 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for port, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:42.553654 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8789863700170', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:42.574426 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:42.589656 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Network fa6231d1-a629-42bc-a091-20035dee3542 is already hosted by enough agents. {{(pid=103244) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 24 11:30:42.592815 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.base_scheduler [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Resources bound (agent type, host, resource id): {{(pid=103244) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 24 11:30:42.596421 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Received port after_create {{(pid=103244) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 24 11:30:42.621065 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'Port': ['ID=a4311927-ef64-4171-8a6f-589311dd49fd,revision_number=1']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:30:42.634980 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:42.635619 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:42.635744 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:42.636035 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:42.636315 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:42.636647 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:42.637023 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:42.637316 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:42.637601 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:42.637923 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:42.638241 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:42.638561 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:30:42.976302 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, precommit_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:43.110237 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-7980674'] for port, before_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:43.264131 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for port, precommit_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:43.334907 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8789864132078', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8789863700188', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8789863700206', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-8699083'] for port, after_update {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:43.402444 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event updated for resources: {'Port': ['ID=a4311927-ef64-4171-8a6f-589311dd49fd,revision_number=2']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:30:43.414913 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-942797'] for floatingip, after_create {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:43.519191 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.db.l3_db [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Floating IP 99bc959e-dcd1-4574-9717-314dd8b2e2cb associated. External IP: 172.27.3.151, port: 9c98cf79-3e0e-4754-bd5a-7f65892246ab. Nov 24 11:30:43.732868 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Router 5ca98cd5-c317-441e-88ed-60cdfa54be52 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:30:43.845532 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:30:43.857625 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-671a7e17-f059-4c7a-9ab9-4a1f18766d78 None None] Sync routers for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:30:43.867124 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-671a7e17-f059-4c7a-9ab9-4a1f18766d78 None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:30:43.870569 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-671a7e17-f059-4c7a-9ab9-4a1f18766d78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:30:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:30:43.937532 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:43.983135 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-0ea2b9c8-b781-4087-9708-e97abe2b3334 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.0406187 Nov 24 11:30:43.983135 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'tag': '9c98cf79-3e0e-4754-bd5a-7f65892246ab'}] {{(pid=103244) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:30:43.983135 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c35ccb4a0c42a3308d76d18e19c746489123f139b4efffac5becb137c8376f98" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-144dcac4-c4cb-46af-a48b-23128047a619" -d '{"events": [{"name": "network-changed", "server_uuid": "d36786aa-8725-4b52-9ee7-19d391c64c93", "tag": "9c98cf79-3e0e-4754-bd5a-7f65892246ab"}]}' {{(pid=103244) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:30:43.984199 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-671a7e17-f059-4c7a-9ab9-4a1f18766d78 None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:30:44.015084 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:30:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c53bbbda-9489-45c7-b846-c9848f998673 x-openstack-request-id: req-c53bbbda-9489-45c7-b846-c9848f998673 {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:30:44.015553 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d36786aa-8725-4b52-9ee7-19d391c64c93", "tag": "9c98cf79-3e0e-4754-bd5a-7f65892246ab", "status": "completed", "code": 200}]} {{(pid=103244) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:30:44.015941 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-c53bbbda-9489-45c7-b846-c9848f998673 {{(pid=103244) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:30:44.016602 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'tag': '9c98cf79-3e0e-4754-bd5a-7f65892246ab', 'status': 'completed', 'code': 200} Nov 24 11:30:44.082062 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144dcac4-c4cb-46af-a48b-23128047a619 req-00f082b8-7dd9-463f-a710-39b351302eb1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:44.083951 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-144dcac4-c4cb-46af-a48b-23128047a619 req-00f082b8-7dd9-463f-a710-39b351302eb1 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 1098 time: 0.0422857 Nov 24 11:30:44.150655 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:44.184587 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144dcac4-c4cb-46af-a48b-23128047a619 req-f5cbb949-0ecc-4208-9493-934e1608d76d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:44.186190 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-144dcac4-c4cb-46af-a48b-23128047a619 req-f5cbb949-0ecc-4208-9493-934e1608d76d service neutron] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 914 time: 0.0957985 Nov 24 11:30:44.234851 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-671a7e17-f059-4c7a-9ab9-4a1f18766d78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '8d67be57-0bf5-49d4-b658-ed2d3e637117', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.155', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 700, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:06:41:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:28:54Z', 'updated_at': '2021-11-24T11:28:56Z', 'revision_number': 1, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}, {'id': '99bc959e-dcd1-4574-9717-314dd8b2e2cb', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.151', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': '9c98cf79-3e0e-4754-bd5a-7f65892246ab', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 703, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:c5:68:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:30:42Z', 'updated_at': '2021-11-24T11:30:42Z', 'revision_number': 0, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:30:44.256539 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-144dcac4-c4cb-46af-a48b-23128047a619 req-f534ebe9-5e04-4463-90b2-010ad10da8d6 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9c98cf79-3e0e-4754-bd5a-7f65892246ab HTTP/1.1" status: 200 len: 999 time: 0.0628347 Nov 24 11:30:44.261760 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-671a7e17-f059-4c7a-9ab9-4a1f18766d78 None None] Checking router: 5ca98cd5-c317-441e-88ed-60cdfa54be52 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:30:44.271466 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-671a7e17-f059-4c7a-9ab9-4a1f18766d78 None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:30:44.272069 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-671a7e17-f059-4c7a-9ab9-4a1f18766d78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:30:41Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:30:44.305740 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144dcac4-c4cb-46af-a48b-23128047a619 req-cbd3902f-e3e9-4be8-a31f-39f480250be3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:44.307135 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-144dcac4-c4cb-46af-a48b-23128047a619 req-cbd3902f-e3e9-4be8-a31f-39f480250be3 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0443840 Nov 24 11:30:44.368313 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144dcac4-c4cb-46af-a48b-23128047a619 req-63d59c5e-66c7-4afa-a7f7-4c26e73fb08d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:30:44.373242 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-144dcac4-c4cb-46af-a48b-23128047a619 req-63d59c5e-66c7-4afa-a7f7-4c26e73fb08d service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0545955 Nov 24 11:30:44.389672 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-671a7e17-f059-4c7a-9ab9-4a1f18766d78 None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:30:44.645447 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-671a7e17-f059-4c7a-9ab9-4a1f18766d78 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '8d67be57-0bf5-49d4-b658-ed2d3e637117', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.155', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 700, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:06:41:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:28:54Z', 'updated_at': '2021-11-24T11:28:56Z', 'revision_number': 1, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}, {'id': '99bc959e-dcd1-4574-9717-314dd8b2e2cb', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.151', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': '9c98cf79-3e0e-4754-bd5a-7f65892246ab', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 703, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:c5:68:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:30:42Z', 'updated_at': '2021-11-24T11:30:42Z', 'revision_number': 0, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:30:44.672694 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-671a7e17-f059-4c7a-9ab9-4a1f18766d78 None None] The sync data for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi is: [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '8d67be57-0bf5-49d4-b658-ed2d3e637117', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.155', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 700, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:06:41:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:28:54Z', 'updated_at': '2021-11-24T11:28:56Z', 'revision_number': 1, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}, {'id': '99bc959e-dcd1-4574-9717-314dd8b2e2cb', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.151', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': '9c98cf79-3e0e-4754-bd5a-7f65892246ab', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 703, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:c5:68:bf', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:30:42Z', 'updated_at': '2021-11-24T11:30:42Z', 'revision_number': 0, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:30:44.748480 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-144dcac4-c4cb-46af-a48b-23128047a619 req-0b3126f2-3f9a-4662-b47b-672b812d1929 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3712177 Nov 24 11:30:44.826235 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:30:44.857583 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-144dcac4-c4cb-46af-a48b-23128047a619 req-8852bb26-cd2b-4914-9dec-9bd8093e1c2d service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1016445 Nov 24 11:30:44.914500 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-577bfb11-2eb7-41a0-beb6-703ed328cecd None None] New status for floating IP 99bc959e-dcd1-4574-9717-314dd8b2e2cb: ACTIVE {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:31:00.061285 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:31:08.744841 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-41662f53-9793-445a-86bf-3604ab0e1e76 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:31:09.334735 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:31:11.168391 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0aeb435d-3b4e-43b3-85ca-48372c780b4f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:31:12.482677 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:31:14.088580 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:31:14.791268 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:31:23.747914 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e7375849-abcc-42b7-a038-3c4bbbb37eab req-a5a4ce9d-9c54-49a1-989a-4edf67b6d69b service neutron] 10.222.0.86 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0762064 Nov 24 11:31:23.832867 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7375849-abcc-42b7-a038-3c4bbbb37eab req-66a28e72-3087-4b09-b21b-7682aa9dd1c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:31:23.834319 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e7375849-abcc-42b7-a038-3c4bbbb37eab req-66a28e72-3087-4b09-b21b-7682aa9dd1c0 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 1098 time: 0.0397112 Nov 24 11:31:23.936822 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7375849-abcc-42b7-a038-3c4bbbb37eab req-73fc94c4-a676-4f4e-8128-ce445136bfd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:31:23.938274 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e7375849-abcc-42b7-a038-3c4bbbb37eab req-73fc94c4-a676-4f4e-8128-ce445136bfd9 service neutron] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 914 time: 0.0856757 Nov 24 11:31:24.003181 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e7375849-abcc-42b7-a038-3c4bbbb37eab req-3544437a-a255-4b14-aea9-9e5f91d1feaa service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a72a34a1-558b-4db8-a803-4c57d2e1a9b8 HTTP/1.1" status: 200 len: 1001 time: 0.0562446 Nov 24 11:31:24.054515 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7375849-abcc-42b7-a038-3c4bbbb37eab req-22a9d317-b92d-4823-b145-1ae2e121f4d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:31:24.055889 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e7375849-abcc-42b7-a038-3c4bbbb37eab req-22a9d317-b92d-4823-b145-1ae2e121f4d7 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0457084 Nov 24 11:31:24.101079 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7375849-abcc-42b7-a038-3c4bbbb37eab req-3111c94b-4292-4af9-a3bd-302b3f6fa633 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:31:24.102705 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e7375849-abcc-42b7-a038-3c4bbbb37eab req-3111c94b-4292-4af9-a3bd-302b3f6fa633 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0392985 Nov 24 11:31:24.190916 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e7375849-abcc-42b7-a038-3c4bbbb37eab req-99f7f6f3-f6e2-4a39-97fd-78966e2c8190 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0801549 Nov 24 11:31:24.282155 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-e7375849-abcc-42b7-a038-3c4bbbb37eab req-c2359f96-7131-47ab-baff-3c7305a56bfe service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0831995 Nov 24 11:31:37.061848 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:31:38.733551 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c75bf439-f65e-4c0d-a52b-3422ede2a201 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:31:39.321929 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:31:41.161777 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-a016461d-69a3-4269-9484-e68abf6e81dd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:31:42.493608 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:31:44.122010 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:31:44.824706 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:08.738992 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-f7db2a42-e3c5-4f02-b958-c8355edef904 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:09.344334 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:11.161232 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c90b676f-a9b6-4d4b-a5ed-591c23934c92 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:12.526756 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:13.072314 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35786) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:13.262832 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Deleting port a4311927-ef64-4171-8a6f-589311dd49fd {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:13.263162 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:13.339480 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:13.339797 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:13.351537 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Calling delete_port for a4311927-ef64-4171-8a6f-589311dd49fd owned by network:floatingip {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:13.584562 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:13.609949 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event deleted for resources: {'Port': ['ID=a4311927-ef64-4171-8a6f-589311dd49fd,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:13.621680 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:13.622043 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:13.622389 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:13.622740 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:13.623056 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:13.623422 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:13.623756 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:13.624086 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:13.624415 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:13.624742 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:13.625060 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:13.625382 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103243) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:13.677625 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:13.677956 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.l3_db [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Floating IP 99bc959e-dcd1-4574-9717-314dd8b2e2cb disassociated (deleted). External IP: 172.27.3.151, port: 9c98cf79-3e0e-4754-bd5a-7f65892246ab. Nov 24 11:32:13.879886 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Router 5ca98cd5-c317-441e-88ed-60cdfa54be52 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:32:13.990939 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:32:13.995635 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:14.000076 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10d3f80d-e230-44b9-8307-be2f9f2e4de0 None None] Sync routers for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:32:14.009380 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10d3f80d-e230-44b9-8307-be2f9f2e4de0 None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:32:14.009993 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-10d3f80d-e230-44b9-8307-be2f9f2e4de0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:32:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:14.022321 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-2eb768f5-1be7-4223-bc45-988122c3ae3c tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "DELETE /v2.0/floatingips/99bc959e-dcd1-4574-9717-314dd8b2e2cb HTTP/1.1" status: 204 len: 168 time: 0.9489543 Nov 24 11:32:14.022923 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'tag': '9c98cf79-3e0e-4754-bd5a-7f65892246ab'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:32:14.025298 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46e81343-ea8e-4f17-9b7e-795115ee8cdf" -d '{"events": [{"name": "network-changed", "server_uuid": "d36786aa-8725-4b52-9ee7-19d391c64c93", "tag": "9c98cf79-3e0e-4754-bd5a-7f65892246ab"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:32:14.072667 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:32:14.119486 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:32:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-14b0e03d-e0d9-43a8-aa14-a9635387c733 x-openstack-request-id: req-14b0e03d-e0d9-43a8-aa14-a9635387c733 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:32:14.119486 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d36786aa-8725-4b52-9ee7-19d391c64c93", "tag": "9c98cf79-3e0e-4754-bd5a-7f65892246ab", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:32:14.119486 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-14b0e03d-e0d9-43a8-aa14-a9635387c733 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:32:14.119486 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'tag': '9c98cf79-3e0e-4754-bd5a-7f65892246ab', 'status': 'completed', 'code': 200} Nov 24 11:32:14.128480 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-10d3f80d-e230-44b9-8307-be2f9f2e4de0 None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:32:14.183447 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e81343-ea8e-4f17-9b7e-795115ee8cdf req-af8af891-6477-485b-bcac-34719f98303a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:14.184871 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-46e81343-ea8e-4f17-9b7e-795115ee8cdf req-af8af891-6477-485b-bcac-34719f98303a service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 1098 time: 0.0417454 Nov 24 11:32:14.226366 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:14.279502 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e81343-ea8e-4f17-9b7e-795115ee8cdf req-4af2f48b-0946-493b-80b8-c256139b3618 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:14.281125 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-46e81343-ea8e-4f17-9b7e-795115ee8cdf req-4af2f48b-0946-493b-80b8-c256139b3618 service neutron] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 914 time: 0.0894473 Nov 24 11:32:14.324904 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-46e81343-ea8e-4f17-9b7e-795115ee8cdf req-042ead92-1091-484b-bbb3-a3f3a21c237c service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=9c98cf79-3e0e-4754-bd5a-7f65892246ab HTTP/1.1" status: 200 len: 217 time: 0.0362985 Nov 24 11:32:14.363763 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-10d3f80d-e230-44b9-8307-be2f9f2e4de0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '8d67be57-0bf5-49d4-b658-ed2d3e637117', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.155', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 700, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:06:41:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:28:54Z', 'updated_at': '2021-11-24T11:28:56Z', 'revision_number': 1, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:14.378312 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e81343-ea8e-4f17-9b7e-795115ee8cdf req-be9b0cd7-19c1-454f-b093-202d2d99df1e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:14.379806 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-46e81343-ea8e-4f17-9b7e-795115ee8cdf req-be9b0cd7-19c1-454f-b093-202d2d99df1e service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0480072 Nov 24 11:32:14.390150 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10d3f80d-e230-44b9-8307-be2f9f2e4de0 None None] Checking router: 5ca98cd5-c317-441e-88ed-60cdfa54be52 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:32:14.400644 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10d3f80d-e230-44b9-8307-be2f9f2e4de0 None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:32:14.401256 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-10d3f80d-e230-44b9-8307-be2f9f2e4de0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:32:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:14.427731 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e81343-ea8e-4f17-9b7e-795115ee8cdf req-639a66f0-4039-4b53-86fa-7e7e7bcdb24a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:14.429230 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-46e81343-ea8e-4f17-9b7e-795115ee8cdf req-639a66f0-4039-4b53-86fa-7e7e7bcdb24a service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0425446 Nov 24 11:32:14.487578 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47ea4427-d026-4183-9b01-d489af88f927 req-d753ce85-5d16-48c4-96f3-b53bcb9a75b5 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:14.489097 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-47ea4427-d026-4183-9b01-d489af88f927 req-d753ce85-5d16-48c4-96f3-b53bcb9a75b5 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 945 time: 0.0510292 Nov 24 11:32:14.510892 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-10d3f80d-e230-44b9-8307-be2f9f2e4de0 None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:32:14.527735 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-46e81343-ea8e-4f17-9b7e-795115ee8cdf req-8388e6e8-72b9-4294-8db5-1ee6cfe5be2f service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0889661 Nov 24 11:32:14.550064 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-47ea4427-d026-4183-9b01-d489af88f927 req-49fea6d0-57ea-4592-8808-2943158e26f6 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0541286 Nov 24 11:32:14.617712 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-46e81343-ea8e-4f17-9b7e-795115ee8cdf req-2b1aaff6-6724-4562-a894-1f3bbf96e605 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817952 Nov 24 11:32:14.732744 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-10d3f80d-e230-44b9-8307-be2f9f2e4de0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '8d67be57-0bf5-49d4-b658-ed2d3e637117', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.155', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 700, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:06:41:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:28:54Z', 'updated_at': '2021-11-24T11:28:56Z', 'revision_number': 1, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:14.766888 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10d3f80d-e230-44b9-8307-be2f9f2e4de0 None None] The sync data for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi is: [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_floatingips': [{'id': '8d67be57-0bf5-49d4-b658-ed2d3e637117', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'floating_ip_address': '172.27.3.155', 'floating_network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'router_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'port_id': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'fixed_ip_address': '172.20.0.6', 'status': 'ACTIVE', 'standard_attr_id': 700, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'mac_address': 'fa:16:3e:06:41:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-24T11:28:54Z', 'updated_at': '2021-11-24T11:28:56Z', 'revision_number': 1, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:32:14.830590 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:14.989579 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98268fa8-14d7-42c0-8f91-4a19016c5eac None None] New status for floating IP 99bc959e-dcd1-4574-9717-314dd8b2e2cb: DOWN {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:32:15.662306 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15fd4f4a-f5f7-463d-a7e2-f019000d58aa req-860668c1-0b9b-4efb-aae3-201e5178d69f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:15.663813 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-15fd4f4a-f5f7-463d-a7e2-f019000d58aa req-860668c1-0b9b-4efb-aae3-201e5178d69f tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 945 time: 0.0490119 Nov 24 11:32:15.713034 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-15fd4f4a-f5f7-463d-a7e2-f019000d58aa req-95259fb0-2230-44c1-8168-f17f7a459ccd tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433464 Nov 24 11:32:15.961411 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31dc0864-bf54-4adb-90c4-f1d7a15b2474 req-ab801553-8759-4736-b43b-658d3b0baba1 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:15.962844 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-31dc0864-bf54-4adb-90c4-f1d7a15b2474 req-ab801553-8759-4736-b43b-658d3b0baba1 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 945 time: 0.0492747 Nov 24 11:32:16.053982 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-31dc0864-bf54-4adb-90c4-f1d7a15b2474 req-0354efe0-a0df-4bd7-84c9-8c3599b381ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Deleting port 9c98cf79-3e0e-4754-bd5a-7f65892246ab {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:16.054242 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-31dc0864-bf54-4adb-90c4-f1d7a15b2474 req-0354efe0-a0df-4bd7-84c9-8c3599b381ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:16.142645 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-31dc0864-bf54-4adb-90c4-f1d7a15b2474 req-0354efe0-a0df-4bd7-84c9-8c3599b381ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] For port 9c98cf79-3e0e-4754-bd5a-7f65892246ab, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=9c98cf79-3e0e-4754-bd5a-7f65892246ab,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:32:16.142999 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-31dc0864-bf54-4adb-90c4-f1d7a15b2474 req-0354efe0-a0df-4bd7-84c9-8c3599b381ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:16.154994 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-31dc0864-bf54-4adb-90c4-f1d7a15b2474 req-0354efe0-a0df-4bd7-84c9-8c3599b381ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Calling delete_port for 9c98cf79-3e0e-4754-bd5a-7f65892246ab owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:16.344078 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-31dc0864-bf54-4adb-90c4-f1d7a15b2474 req-0354efe0-a0df-4bd7-84c9-8c3599b381ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:16.370967 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0354efe0-a0df-4bd7-84c9-8c3599b381ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event deleted for resources: {'Port': ['ID=9c98cf79-3e0e-4754-bd5a-7f65892246ab,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:16.418223 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-31dc0864-bf54-4adb-90c4-f1d7a15b2474 req-0354efe0-a0df-4bd7-84c9-8c3599b381ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] No DVR routers for this DVR port 9c98cf79-3e0e-4754-bd5a-7f65892246ab on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:32:16.419390 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-31dc0864-bf54-4adb-90c4-f1d7a15b2474 req-0354efe0-a0df-4bd7-84c9-8c3599b381ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:16.422882 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-31dc0864-bf54-4adb-90c4-f1d7a15b2474 req-0354efe0-a0df-4bd7-84c9-8c3599b381ef tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "DELETE /v2.0/ports/9c98cf79-3e0e-4754-bd5a-7f65892246ab HTTP/1.1" status: 204 len: 173 time: 0.4533312 Nov 24 11:32:16.423353 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'name': 'network-vif-deleted', 'tag': '9c98cf79-3e0e-4754-bd5a-7f65892246ab'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:32:16.426171 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da1d1768-1113-43c0-bcaf-05a281493639" -d '{"events": [{"server_uuid": "d36786aa-8725-4b52-9ee7-19d391c64c93", "name": "network-vif-deleted", "tag": "9c98cf79-3e0e-4754-bd5a-7f65892246ab"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:32:16.462251 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:32:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e0e41d97-53b7-47f5-b6ca-994c0f464f0e x-openstack-request-id: req-e0e41d97-53b7-47f5-b6ca-994c0f464f0e {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:32:16.462607 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d36786aa-8725-4b52-9ee7-19d391c64c93", "name": "network-vif-deleted", "tag": "9c98cf79-3e0e-4754-bd5a-7f65892246ab", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:32:16.462864 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-e0e41d97-53b7-47f5-b6ca-994c0f464f0e {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:32:16.463307 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd36786aa-8725-4b52-9ee7-19d391c64c93', 'name': 'network-vif-deleted', 'tag': '9c98cf79-3e0e-4754-bd5a-7f65892246ab', 'status': 'completed', 'code': 200} Nov 24 11:32:16.814029 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-ff0c0423-b5fa-4d14-9d87-78bb22ae2416 req-0ac78f7e-52e9-4fee-9db2-281cc813a058 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=d36786aa-8725-4b52-9ee7-19d391c64c93 HTTP/1.1" status: 200 len: 210 time: 0.0282815 Nov 24 11:32:19.743019 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 9c98cf79-3e0e-4754-bd5a-7f65892246ab no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:32:19.762990 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: 9c98cf79-3e0e-4754-bd5a-7f65892246ab {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:32:19.763354 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device 9c98cf79-3e0e-4754-bd5a-7f65892246ab not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:32:20.305556 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35832) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:20.458168 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Deleting port af6e233e-3ac5-4f07-8294-8e6dd705a5dd {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:20.458500 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:20.531767 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:20.533182 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:20.547209 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Calling delete_port for af6e233e-3ac5-4f07-8294-8e6dd705a5dd owned by network:floatingip {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:20.749444 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:20.774632 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event deleted for resources: {'Port': ['ID=af6e233e-3ac5-4f07-8294-8e6dd705a5dd,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:20.841702 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:20.842031 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.db.l3_db [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Floating IP 8d67be57-0bf5-49d4-b658-ed2d3e637117 disassociated (deleted). External IP: 172.27.3.155, port: a72a34a1-558b-4db8-a803-4c57d2e1a9b8. Nov 24 11:32:21.049693 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Router 5ca98cd5-c317-441e-88ed-60cdfa54be52 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:32:21.154257 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:32:21.158904 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:21.163838 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d66a8dcf-3ee3-4843-9f6c-88c2032be62a None None] Sync routers for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:32:21.173304 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d66a8dcf-3ee3-4843-9f6c-88c2032be62a None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:32:21.173987 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-d66a8dcf-3ee3-4843-9f6c-88c2032be62a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:32:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:21.186386 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-92848248-ab76-4397-a1ae-ab0ae02de099 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "DELETE /v2.0/floatingips/8d67be57-0bf5-49d4-b658-ed2d3e637117 HTTP/1.1" status: 204 len: 168 time: 0.8797410 Nov 24 11:32:21.186966 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'tag': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:32:21.189206 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8c635a82-c03b-4f6a-8ecf-cebb30721c02" -d '{"events": [{"name": "network-changed", "server_uuid": "6a583cf0-137a-48a6-b542-3b05eef5a5c9", "tag": "a72a34a1-558b-4db8-a803-4c57d2e1a9b8"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:32:21.230369 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 24 Nov 2021 11:32:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e9b1e3c4-8b37-447f-ad36-1a4e4c6d7694 x-openstack-request-id: req-e9b1e3c4-8b37-447f-ad36-1a4e4c6d7694 {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:32:21.231064 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6a583cf0-137a-48a6-b542-3b05eef5a5c9", "tag": "a72a34a1-558b-4db8-a803-4c57d2e1a9b8", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:32:21.231342 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-e9b1e3c4-8b37-447f-ad36-1a4e4c6d7694 {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:32:21.231752 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'tag': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'status': 'completed', 'code': 200} Nov 24 11:32:21.298420 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c635a82-c03b-4f6a-8ecf-cebb30721c02 req-8bdef674-1b50-4f89-80a4-3a7b394cef61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:21.300095 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-8c635a82-c03b-4f6a-8ecf-cebb30721c02 req-8bdef674-1b50-4f89-80a4-3a7b394cef61 service neutron] 10.222.0.86 "GET /v2.0/ports?tenant_id=c672667e55bd470cba00102a41b7ea85&device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 1098 time: 0.0452204 Nov 24 11:32:21.397743 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c635a82-c03b-4f6a-8ecf-cebb30721c02 req-36e14b7d-fc2b-4c33-be34-7fe1eaa1a6f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:21.400018 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-8c635a82-c03b-4f6a-8ecf-cebb30721c02 req-36e14b7d-fc2b-4c33-be34-7fe1eaa1a6f9 service neutron] 10.222.0.86 "GET /v2.0/networks?id=50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 200 len: 914 time: 0.0933390 Nov 24 11:32:21.411266 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-d66a8dcf-3ee3-4843-9f6c-88c2032be62a None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:32:21.446597 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-8c635a82-c03b-4f6a-8ecf-cebb30721c02 req-95672a6d-05c5-4a29-a1d2-db0e88efa3a7 service neutron] 10.222.0.86 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=a72a34a1-558b-4db8-a803-4c57d2e1a9b8 HTTP/1.1" status: 200 len: 217 time: 0.0383463 Nov 24 11:32:21.497657 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c635a82-c03b-4f6a-8ecf-cebb30721c02 req-45831014-e9d5-4aea-b373-47c3180c2315 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:21.499169 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-8c635a82-c03b-4f6a-8ecf-cebb30721c02 req-45831014-e9d5-4aea-b373-47c3180c2315 service neutron] 10.222.0.86 "GET /v2.0/subnets?id=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 200 len: 851 time: 0.0451860 Nov 24 11:32:21.551222 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c635a82-c03b-4f6a-8ecf-cebb30721c02 req-a8a25535-8daf-4ce6-87b1-0b4a307c0d96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:21.552809 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-8c635a82-c03b-4f6a-8ecf-cebb30721c02 req-a8a25535-8daf-4ce6-87b1-0b4a307c0d96 service neutron] 10.222.0.86 "GET /v2.0/ports?network_id=50c03ad4-9543-459f-a58f-7999897d09ac&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1176 time: 0.0463219 Nov 24 11:32:21.619742 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-d66a8dcf-3ee3-4843-9f6c-88c2032be62a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:21.630152 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20a65db-af84-4547-b874-269f62a39b18 req-673b9dd2-97a5-4bd8-938e-040887f67d36 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:21.637717 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d20a65db-af84-4547-b874-269f62a39b18 req-673b9dd2-97a5-4bd8-938e-040887f67d36 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 945 time: 0.0614462 Nov 24 11:32:21.646879 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d66a8dcf-3ee3-4843-9f6c-88c2032be62a None None] Checking router: 5ca98cd5-c317-441e-88ed-60cdfa54be52 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:32:21.650246 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-8c635a82-c03b-4f6a-8ecf-cebb30721c02 req-72102924-6a34-4c9b-b9f5-2fe16d0a66f3 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886440 Nov 24 11:32:21.655153 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d66a8dcf-3ee3-4843-9f6c-88c2032be62a None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:32:21.655811 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-d66a8dcf-3ee3-4843-9f6c-88c2032be62a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:32:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:21.691894 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-d20a65db-af84-4547-b874-269f62a39b18 req-56e3b27d-ca83-482e-bc40-ee7563117382 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511043 Nov 24 11:32:21.743634 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-8c635a82-c03b-4f6a-8ecf-cebb30721c02 req-c93d2af0-5550-4d0d-8816-9dfbfcbac060 service neutron] 10.222.0.86 "GET /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860398 Nov 24 11:32:21.771007 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-d66a8dcf-3ee3-4843-9f6c-88c2032be62a None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:32:21.975784 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-d66a8dcf-3ee3-4843-9f6c-88c2032be62a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:22.002085 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d66a8dcf-3ee3-4843-9f6c-88c2032be62a None None] The sync data for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi is: [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:25:46Z', 'revision_number': 4, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi', '_interfaces': [{'id': '42750708-69ee-4c4a-b960-54454ae9313f', 'name': '', 'network_id': '50c03ad4-9543-459f-a58f-7999897d09ac', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'mac_address': 'fa:16:3e:e2:8a:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_interface', 'standard_attr_id': 673, 'fixed_ips': [{'subnet_id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:45Z', 'updated_at': '2021-11-24T11:25:49Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'subnets': [{'id': '7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:32:22.216928 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f2c89ab5-74ce-4d80-a18f-d16002229ebe None None] New status for floating IP 8d67be57-0bf5-49d4-b658-ed2d3e637117: DOWN {{(pid=103246) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 24 11:32:22.805028 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7ea4024-bc46-4474-b189-54f2786f5bc1 req-570191da-6e51-4355-84ef-554a4ad54a37 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103244) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:22.806490 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e7ea4024-bc46-4474-b189-54f2786f5bc1 req-570191da-6e51-4355-84ef-554a4ad54a37 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 945 time: 0.0493999 Nov 24 11:32:22.855348 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-e7ea4024-bc46-4474-b189-54f2786f5bc1 req-ef89b7fe-2d4a-4206-82dc-2471bceaaf91 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/security-groups?id=3995c765-1ba2-40f8-bda1-be920c60a01a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430229 Nov 24 11:32:23.068131 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f5ed68-0d7c-4c4b-b70f-715efeb7e30c req-abdce863-a58c-484d-a36b-945155cde96b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=103243) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 24 11:32:23.069475 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-86f5ed68-0d7c-4c4b-b70f-715efeb7e30c req-abdce863-a58c-484d-a36b-945155cde96b tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 945 time: 0.0476239 Nov 24 11:32:23.155924 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-86f5ed68-0d7c-4c4b-b70f-715efeb7e30c req-7206ac47-c8ca-41ad-adf6-bd37ee1ffaed tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Deleting port a72a34a1-558b-4db8-a803-4c57d2e1a9b8 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:23.156261 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-86f5ed68-0d7c-4c4b-b70f-715efeb7e30c req-7206ac47-c8ca-41ad-adf6-bd37ee1ffaed tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:23.501175 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [req-86f5ed68-0d7c-4c4b-b70f-715efeb7e30c req-7206ac47-c8ca-41ad-adf6-bd37ee1ffaed tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] For port a72a34a1-558b-4db8-a803-4c57d2e1a9b8, host hv-cinder-80403, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80403',level=0,port_id=a72a34a1-558b-4db8-a803-4c57d2e1a9b8,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:32:23.501617 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-86f5ed68-0d7c-4c4b-b70f-715efeb7e30c req-7206ac47-c8ca-41ad-adf6-bd37ee1ffaed tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:23.514618 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [req-86f5ed68-0d7c-4c4b-b70f-715efeb7e30c req-7206ac47-c8ca-41ad-adf6-bd37ee1ffaed tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Calling delete_port for a72a34a1-558b-4db8-a803-4c57d2e1a9b8 owned by compute:nova {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:23.676488 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-86f5ed68-0d7c-4c4b-b70f-715efeb7e30c req-7206ac47-c8ca-41ad-adf6-bd37ee1ffaed tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:23.703613 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7206ac47-c8ca-41ad-adf6-bd37ee1ffaed tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event deleted for resources: {'Port': ['ID=a72a34a1-558b-4db8-a803-4c57d2e1a9b8,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:23.744353 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [req-86f5ed68-0d7c-4c4b-b70f-715efeb7e30c req-7206ac47-c8ca-41ad-adf6-bd37ee1ffaed tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] No DVR routers for this DVR port a72a34a1-558b-4db8-a803-4c57d2e1a9b8 on host hv-cinder-80403 {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:32:23.746783 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [req-86f5ed68-0d7c-4c4b-b70f-715efeb7e30c req-7206ac47-c8ca-41ad-adf6-bd37ee1ffaed tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for port, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:23.750053 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [req-86f5ed68-0d7c-4c4b-b70f-715efeb7e30c req-7206ac47-c8ca-41ad-adf6-bd37ee1ffaed tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.86 "DELETE /v2.0/ports/a72a34a1-558b-4db8-a803-4c57d2e1a9b8 HTTP/1.1" status: 204 len: 173 time: 0.6742215 Nov 24 11:32:23.750505 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'name': 'network-vif-deleted', 'tag': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8'}] {{(pid=103243) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 24 11:32:23.752813 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.76/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b42abe5912319ef138152c489c7000c9513f4c944c68fe4d175c58a8375d15c6" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5a64fb35-121a-40a6-8714-76b286c84ad1" -d '{"events": [{"server_uuid": "6a583cf0-137a-48a6-b542-3b05eef5a5c9", "name": "network-vif-deleted", "tag": "a72a34a1-558b-4db8-a803-4c57d2e1a9b8"}]}' {{(pid=103243) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 24 11:32:23.789518 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Wed, 24 Nov 2021 11:32:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a99bf7fe-d2c2-4f73-abd5-63ed6121467f x-openstack-request-id: req-a99bf7fe-d2c2-4f73-abd5-63ed6121467f {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 24 11:32:23.789819 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6a583cf0-137a-48a6-b542-3b05eef5a5c9", "name": "network-vif-deleted", "tag": "a72a34a1-558b-4db8-a803-4c57d2e1a9b8", "status": "completed", "code": 200}]} {{(pid=103243) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 24 11:32:23.790074 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.76/compute/v2.1/os-server-external-events used request id req-a99bf7fe-d2c2-4f73-abd5-63ed6121467f {{(pid=103243) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 24 11:32:23.790540 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6a583cf0-137a-48a6-b542-3b05eef5a5c9', 'name': 'network-vif-deleted', 'tag': 'a72a34a1-558b-4db8-a803-4c57d2e1a9b8', 'status': 'completed', 'code': 200} Nov 24 11:32:23.947278 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [req-f52f7f26-14d2-472a-b6f1-3845e425d993 req-4cf5d842-38b5-4e5d-8bbb-f461eb0dbf37 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "GET /v2.0/ports?device_id=6a583cf0-137a-48a6-b542-3b05eef5a5c9 HTTP/1.1" status: 200 len: 210 time: 0.0253015 Nov 24 11:32:25.003908 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35848) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:25.128198 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-4a37a280-de18-4cc4-8e90-14aea7eeb931 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Deleting port 28beda15-905f-48ee-9178-8e92ae358cab {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:25.128532 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4a37a280-de18-4cc4-8e90-14aea7eeb931 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:25.200485 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4a37a280-de18-4cc4-8e90-14aea7eeb931 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:25.200799 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4a37a280-de18-4cc4-8e90-14aea7eeb931 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:25.212665 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-4a37a280-de18-4cc4-8e90-14aea7eeb931 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Calling delete_port for 28beda15-905f-48ee-9178-8e92ae358cab owned by network:floatingip {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:25.389966 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4a37a280-de18-4cc4-8e90-14aea7eeb931 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:25.416388 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a37a280-de18-4cc4-8e90-14aea7eeb931 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event deleted for resources: {'Port': ['ID=28beda15-905f-48ee-9178-8e92ae358cab,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:25.477098 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4a37a280-de18-4cc4-8e90-14aea7eeb931 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for floatingip, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:25.479743 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-4a37a280-de18-4cc4-8e90-14aea7eeb931 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-67233'] for floatingip, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:25.480880 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-4a37a280-de18-4cc4-8e90-14aea7eeb931 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "DELETE /v2.0/floatingips/54303b0b-9e33-4514-95db-75ec43597cf5 HTTP/1.1" status: 204 len: 168 time: 0.4759653 Nov 24 11:32:26.802203 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35860) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:26.862191 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1ae0f121-1caf-49f2-8ac6-6ad290639550 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:26.888137 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1ae0f121-1caf-49f2-8ac6-6ad290639550 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:27.053015 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1ae0f121-1caf-49f2-8ac6-6ad290639550 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:27.055941 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-1ae0f121-1caf-49f2-8ac6-6ad290639550 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Publish callbacks [] for security_group, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:27.057158 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-1ae0f121-1caf-49f2-8ac6-6ad290639550 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] 10.222.0.76 "DELETE /v2.0/security-groups/3995c765-1ba2-40f8-bda1-be920c60a01a HTTP/1.1" status: 204 len: 168 time: 0.2539377 Nov 24 11:32:27.066473 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ae0f121-1caf-49f2-8ac6-6ad290639550 tempest-TestVolumeBootPattern-1207410400 tempest-TestVolumeBootPattern-1207410400-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3995c765-1ba2-40f8-bda1-be920c60a01a,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:27.191490 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35864) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:27.633259 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6f4645eb-9f77-4772-a3cd-02978b88338c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1009613'] for router_interface, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:27.751863 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device a72a34a1-558b-4db8-a803-4c57d2e1a9b8 no longer exists at agent hyperv_hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:32:27.772022 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] No Port match for: a72a34a1-558b-4db8-a803-4c57d2e1a9b8 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:32:27.772368 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Device a72a34a1-558b-4db8-a803-4c57d2e1a9b8 not bound to the agent host hv-cinder-80403 {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:32:27.867005 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-6f4645eb-9f77-4772-a3cd-02978b88338c admin admin] Deleting port 42750708-69ee-4c4a-b960-54454ae9313f {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:27.867640 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6f4645eb-9f77-4772-a3cd-02978b88338c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:27.946549 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [None req-6f4645eb-9f77-4772-a3cd-02978b88338c admin admin] For port 42750708-69ee-4c4a-b960-54454ae9313f, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=42750708-69ee-4c4a-b960-54454ae9313f,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:32:27.946901 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6f4645eb-9f77-4772-a3cd-02978b88338c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:27.958995 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-6f4645eb-9f77-4772-a3cd-02978b88338c admin admin] Calling delete_port for 42750708-69ee-4c4a-b960-54454ae9313f owned by network:router_interface {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:28.224211 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6f4645eb-9f77-4772-a3cd-02978b88338c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:28.248886 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f4645eb-9f77-4772-a3cd-02978b88338c admin admin] Pushing event deleted for resources: {'Port': ['ID=42750708-69ee-4c4a-b960-54454ae9313f,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:28.413603 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-6f4645eb-9f77-4772-a3cd-02978b88338c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-637217', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1011037'] for router_interface, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:28.620488 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6f4645eb-9f77-4772-a3cd-02978b88338c admin admin] Router 5ca98cd5-c317-441e-88ed-60cdfa54be52 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103243) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:32:28.723506 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6f4645eb-9f77-4772-a3cd-02978b88338c admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103243) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:32:28.729930 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-6f4645eb-9f77-4772-a3cd-02978b88338c admin admin] 10.222.0.76 "PUT /v2.0/routers/5ca98cd5-c317-441e-88ed-60cdfa54be52/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5373876 Nov 24 11:32:28.731673 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35868) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:28.733113 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5a8d0f9-73c5-4fab-ae3a-d11581048a6c None None] Sync routers for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:32:28.743722 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5a8d0f9-73c5-4fab-ae3a-d11581048a6c None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:32:28.744396 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-c5a8d0f9-73c5-4fab-ae3a-d11581048a6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:32:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:28.834276 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Publish callbacks [] for router, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:28.847580 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-c5a8d0f9-73c5-4fab-ae3a-d11581048a6c None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:32:28.935668 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.026094 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-c5a8d0f9-73c5-4fab-ae3a-d11581048a6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24'}], 'enable_snat': True}, 'gw_port_id': '04914236-5365-496a-bed5-57e1bc421493', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:32:28Z', 'revision_number': 5, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port': {'id': '04914236-5365-496a-bed5-57e1bc421493', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:7c:ec:f3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'device_owner': 'network:router_gateway', 'standard_attr_id': 672, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.24', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:43Z', 'updated_at': '2021-11-24T11:25:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:29.050342 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Deleting port 04914236-5365-496a-bed5-57e1bc421493 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:29.050678 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.053824 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5a8d0f9-73c5-4fab-ae3a-d11581048a6c None None] Checking router: 5ca98cd5-c317-441e-88ed-60cdfa54be52 for host: dv-cinder-804035-18-iscsi {{(pid=103245) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:32:29.062637 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5a8d0f9-73c5-4fab-ae3a-d11581048a6c None None] Routers {'5ca98cd5-c317-441e-88ed-60cdfa54be52'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103245) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:32:29.063236 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-c5a8d0f9-73c5-4fab-ae3a-d11581048a6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:32:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['5ca98cd5-c317-441e-88ed-60cdfa54be52'], 'active': True} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:29.132574 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] For port 04914236-5365-496a-bed5-57e1bc421493, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=04914236-5365-496a-bed5-57e1bc421493,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:32:29.132985 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.145119 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Calling delete_port for 04914236-5365-496a-bed5-57e1bc421493 owned by network:router_gateway {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:29.148893 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvr_db [None req-c5a8d0f9-73c5-4fab-ae3a-d11581048a6c None None] Set router 5ca98cd5-c317-441e-88ed-60cdfa54be52 gateway port host: None {{(pid=103245) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:32:29.202472 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_hamode_db [None req-c5a8d0f9-73c5-4fab-ae3a-d11581048a6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:32:28Z', 'revision_number': 6, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port_host': None}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103245) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:29.229031 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5a8d0f9-73c5-4fab-ae3a-d11581048a6c None None] The sync data for ids ['5ca98cd5-c317-441e-88ed-60cdfa54be52'] in dv-cinder-804035-18-iscsi is: [{'id': '5ca98cd5-c317-441e-88ed-60cdfa54be52', 'name': 'tempest-TestVolumeBootPattern-1236384317-router', 'tenant_id': 'c672667e55bd470cba00102a41b7ea85', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:42Z', 'updated_at': '2021-11-24T11:32:28Z', 'revision_number': 6, 'project_id': 'c672667e55bd470cba00102a41b7ea85', 'gw_port_host': None}] {{(pid=103245) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:32:29.371859 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.394138 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Pushing event deleted for resources: {'Port': ['ID=04914236-5365-496a-bed5-57e1bc421493,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:29.455807 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-942710'] for router_gateway, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.544229 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1010955', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-663'] for router, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.547037 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.675846 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1010962'] for router, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.676402 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 5ca98cd5-c317-441e-88ed-60cdfa54be52 {{(pid=103243) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 11:32:29.680948 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] Publish callbacks [] for router, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.682157 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-5c97a9ed-7765-467a-b09e-53cdf2165b3f admin admin] 10.222.0.76 "DELETE /v2.0/routers/5ca98cd5-c317-441e-88ed-60cdfa54be52 HTTP/1.1" status: 204 len: 168 time: 0.9495418 Nov 24 11:32:29.684804 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35870) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:29.734151 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.db_base_plugin_v2 [None req-37124bba-e4e3-4f8e-8bb2-45bb6c8e477e admin admin] Deleting subnet 7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe {{(pid=103243) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:32:29.737108 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-37124bba-e4e3-4f8e-8bb2-45bb6c8e477e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.770523 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-37124bba-e4e3-4f8e-8bb2-45bb6c8e477e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-9292937'] for subnet, precommit_delete_associations {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.852503 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-37124bba-e4e3-4f8e-8bb2-45bb6c8e477e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.944273 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-37124bba-e4e3-4f8e-8bb2-45bb6c8e477e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8721838', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-9106635'] for subnet, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.970052 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37124bba-e4e3-4f8e-8bb2-45bb6c8e477e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:29.973761 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-37124bba-e4e3-4f8e-8bb2-45bb6c8e477e admin admin] Publish callbacks [] for subnet, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:29.977948 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-37124bba-e4e3-4f8e-8bb2-45bb6c8e477e admin admin] 10.222.0.76 "DELETE /v2.0/subnets/7f8d316d-b9ee-4b0b-9afc-e62ffa4c6ebe HTTP/1.1" status: 204 len: 168 time: 0.2919488 Nov 24 11:32:29.980418 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [-] (103243) accepted ('10.222.0.76', 35872) {{(pid=103243) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:29.985490 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-effd9ad8-528b-471a-877c-66228ec81109 None None] Network 50c03ad4-9543-459f-a58f-7999897d09ac requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:32:30.006842 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 42750708-69ee-4c4a-b960-54454ae9313f no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:32:30.042037 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 42750708-69ee-4c4a-b960-54454ae9313f {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:32:30.042376 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 42750708-69ee-4c4a-b960-54454ae9313f not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:32:30.060521 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.119531 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Deleting port 15a0a169-e87f-4bf7-930d-de986f01a061 {{(pid=103243) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:30.119868 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.183242 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.db [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] For port 15a0a169-e87f-4bf7-930d-de986f01a061, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=15a0a169-e87f-4bf7-930d-de986f01a061,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103243) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:32:30.183650 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.188035 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] DHCP port deletion for 50c03ad4-9543-459f-a58f-7999897d09ac request from dv-cinder-804035-18-iscsi {{(pid=103245) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 11:32:30.199656 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.plugin [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Calling delete_port for 15a0a169-e87f-4bf7-930d-de986f01a061 owned by network:dhcp {{(pid=103243) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:30.242428 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Deleting port 15a0a169-e87f-4bf7-930d-de986f01a061 {{(pid=103245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:30.242715 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.305229 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] For port 15a0a169-e87f-4bf7-930d-de986f01a061, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=15a0a169-e87f-4bf7-930d-de986f01a061,segment=NetworkSegment(a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3),segment_id=a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:32:30.305629 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.318447 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Calling delete_port for 15a0a169-e87f-4bf7-930d-de986f01a061 owned by network:dhcp {{(pid=103245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:30.361119 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8721907'] for port, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.384613 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [req-9e40d8f2-e64a-4f81-9ba9-8cdd2b7c7b0a req-63f1d31d-bb86-4b57-a689-af5890571610 service neutron] (103243) timed out ('10.222.0.86', 56843) {{(pid=103243) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 24 11:32:30.387384 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Pushing event deleted for resources: {'Port': ['ID=15a0a169-e87f-4bf7-930d-de986f01a061,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:30.392435 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] No DVR routers for this DVR port 15a0a169-e87f-4bf7-930d-de986f01a061 on host dv-cinder-804035-18-iscsi {{(pid=103243) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:32:30.398012 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.424271 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Pushing event deleted for resources: {'Port': ['ID=15a0a169-e87f-4bf7-930d-de986f01a061,revision_number=None']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:30.428107 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] No DVR routers for this DVR port 15a0a169-e87f-4bf7-930d-de986f01a061 on host dv-cinder-804035-18-iscsi {{(pid=103245) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:32:30.434510 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:30.434856 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:30.435557 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:30.435557 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:30.435900 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:30.436241 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:30.436559 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:30.436881 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:30.437207 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:30.437527 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:30.437847 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:30.438651 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-689f7ac8-6b2d-4150-99f0-2546c143cc8b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103245) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:30.468557 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.488000 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['50c03ad4-9543-459f-a58f-7999897d09ac']}} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:30.497142 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3') {'for_net_delete': True} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:30.497379 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.services.segments.db [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a29c6c45-2e52-4f29-a38d-c9cd2c3e1fd3') {} {{(pid=103243) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:30.507042 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-9292944'] for segment, before_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.520012 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.526645 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Releasing vlan 1213 on physical network physnet1 to pool {{(pid=103243) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8721920'] for segment, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: Traceback (most recent call last): Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: timer() Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: cb(*args, **kw) Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: return func(*args, **kwargs) Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: self._notify() Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: self.callback(batched_events) Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: event.method(event) Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: return f(self, *a, **k) Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._get(url).json() Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: return self.request(url, 'GET', **kwargs) Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:32:30.540795 dv-cinder-804035-18-iscsi neutron-server[103243]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:32:30.629144 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.635102 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron_lib.callbacks.manager [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103243) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:30.638229 dv-cinder-804035-18-iscsi neutron-server[103243]: INFO neutron.wsgi [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] 10.222.0.76 "DELETE /v2.0/networks/50c03ad4-9543-459f-a58f-7999897d09ac HTTP/1.1" status: 204 len: 168 time: 0.6569030 Nov 24 11:32:30.641306 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35874) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:30.649633 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fcd22e1-d636-4f1f-94a1-6be38082a36a admin admin] Pushing event deleted for resources: {'Network': ['ID=50c03ad4-9543-459f-a58f-7999897d09ac,revision_number=None']} {{(pid=103243) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:31.228239 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1009613'] for router_interface, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:31.468946 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Deleting port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:31.469188 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:31.547237 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] For port 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1,segment=NetworkSegment(cae3f2af-a231-4163-8e6d-d9f38b413291),segment_id=cae3f2af-a231-4163-8e6d-d9f38b413291)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:32:31.547633 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:31.561229 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Calling delete_port for 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 owned by network:router_interface {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:31.591909 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 04914236-5365-496a-bed5-57e1bc421493 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:32:31.612286 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 04914236-5365-496a-bed5-57e1bc421493 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:32:31.612628 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 04914236-5365-496a-bed5-57e1bc421493 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:32:31.613027 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 15a0a169-e87f-4bf7-930d-de986f01a061 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:32:31.631944 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 15a0a169-e87f-4bf7-930d-de986f01a061 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:32:31.632286 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 15a0a169-e87f-4bf7-930d-de986f01a061 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:32:31.806858 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:31.832532 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Pushing event deleted for resources: {'Port': ['ID=3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:31.847619 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:31.847971 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:31.848384 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:31.848647 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:31.849785 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:31.850143 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:31.850476 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:31.850806 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:31.851134 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:31.851484 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:31.851816 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:31.852558 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804035-18-iscsi {{(pid=103244) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 24 11:32:32.014753 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-637217', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1011037'] for router_interface, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:32.226960 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Router cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 has already been hosted by L3 agent e5d356e0-9bf2-49eb-a810-1696e7192260 {{(pid=103244) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 24 11:32:32.330295 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] Notify agent at l3_agent.dv-cinder-804035-18-iscsi the message routers_updated {{(pid=103244) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 24 11:32:32.335596 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-fbc36877-a3f9-4243-b805-3393abf3c460 admin admin] 10.222.0.76 "PUT /v2.0/routers/cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6931574 Nov 24 11:32:32.338324 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35876) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:32.339340 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86695e22-94f3-41a7-8ed4-d5227045edc7 None None] Sync routers for ids ['cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'] in dv-cinder-804035-18-iscsi {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 24 11:32:32.349063 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86695e22-94f3-41a7-8ed4-d5227045edc7 None None] Routers {'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:32:32.349710 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-86695e22-94f3-41a7-8ed4-d5227045edc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:32:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:32.440220 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Publish callbacks [] for router, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:32.452972 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-86695e22-94f3-41a7-8ed4-d5227045edc7 None None] Set router cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 gateway port host: dv-cinder-804035-18-iscsi {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:32:32.539111 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:32.624046 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-86695e22-94f3-41a7-8ed4-d5227045edc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'name': 'tempest-TestVolumeBootPattern-292028924-router', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'external_fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225'}], 'enable_snat': True}, 'gw_port_id': '53980824-f312-4480-8664-cc03f9d7e928', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:48Z', 'updated_at': '2021-11-24T11:32:31Z', 'revision_number': 5, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'gw_port': {'id': '53980824-f312-4480-8664-cc03f9d7e928', 'name': '', 'network_id': 'fa6231d1-a629-42bc-a091-20035dee3542', 'tenant_id': '', 'mac_address': 'fa:16:3e:18:fa:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 684, 'fixed_ips': [{'subnet_id': '741c8451-f41e-4184-b25a-74d54247c82b', 'ip_address': '172.27.3.225', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804035-18-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-24T11:25:49Z', 'updated_at': '2021-11-24T11:25:55Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '741c8451-f41e-4184-b25a-74d54247c82b', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804035-18-iscsi'}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:32.653853 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86695e22-94f3-41a7-8ed4-d5227045edc7 None None] Checking router: cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 for host: dv-cinder-804035-18-iscsi {{(pid=103246) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 24 11:32:32.662870 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvrscheduler_db [None req-86695e22-94f3-41a7-8ed4-d5227045edc7 None None] Routers {'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'} bound to L3 agent in host dv-cinder-804035-18-iscsi {{(pid=103246) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 24 11:32:32.663512 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-86695e22-94f3-41a7-8ed4-d5227045edc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804035-18-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-24T11:07:11Z,description=,heartbeat_timestamp=2021-11-24T11:32:11Z,host='dv-cinder-804035-18-iscsi',id=e5d356e0-9bf2-49eb-a810-1696e7192260,load=0,resource_versions=,resources_synced=,started_at=2021-11-24T11:07:12Z,topic='l3_agent')) {'router_ids': ['cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'], 'active': True} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:32.677461 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Deleting port 53980824-f312-4480-8664-cc03f9d7e928 {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:32.677803 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:32.754127 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_dvr_db [None req-86695e22-94f3-41a7-8ed4-d5227045edc7 None None] Set router cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 gateway port host: None {{(pid=103246) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 24 11:32:32.755071 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] For port 53980824-f312-4480-8664-cc03f9d7e928, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=53980824-f312-4480-8664-cc03f9d7e928,segment=NetworkSegment(bdf7c96b-efac-48c4-9baf-722b3b6d5627),segment_id=bdf7c96b-efac-48c4-9baf-722b3b6d5627)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:32:32.755996 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:32.768418 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Calling delete_port for 53980824-f312-4480-8664-cc03f9d7e928 owned by network:router_gateway {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:32.805918 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.l3_hamode_db [None req-86695e22-94f3-41a7-8ed4-d5227045edc7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'name': 'tempest-TestVolumeBootPattern-292028924-router', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:48Z', 'updated_at': '2021-11-24T11:32:32Z', 'revision_number': 6, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'gw_port_host': None}], 'dv-cinder-804035-18-iscsi', False) {} {{(pid=103246) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:32.835476 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86695e22-94f3-41a7-8ed4-d5227045edc7 None None] The sync data for ids ['cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3'] in dv-cinder-804035-18-iscsi is: [{'id': 'cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3', 'name': 'tempest-TestVolumeBootPattern-292028924-router', 'tenant_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-24T11:25:48Z', 'updated_at': '2021-11-24T11:32:32Z', 'revision_number': 6, 'project_id': 'd3a0be31ba5a44fd9fa8f4eb91244039', 'gw_port_host': None}] {{(pid=103246) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 24 11:32:33.018100 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.041427 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Pushing event deleted for resources: {'Port': ['ID=53980824-f312-4480-8664-cc03f9d7e928,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:33.106617 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-942710'] for router_gateway, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.200334 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1010955', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-663'] for router, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.202544 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.441445 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1010962'] for router, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.441916 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Fanout notify agent at l3_agent the message router_deleted on router cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 {{(pid=103244) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 24 11:32:33.448184 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] Publish callbacks [] for router, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.448184 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-dbcf882f-c76f-467d-a86f-a0bd160f4a74 admin admin] 10.222.0.76 "DELETE /v2.0/routers/cc98b2e1-6339-4399-9faf-6ff5a3d2cfb3 HTTP/1.1" status: 204 len: 168 time: 1.1082737 Nov 24 11:32:33.450399 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35878) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:33.495574 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.db_base_plugin_v2 [None req-4df53d4d-4baa-44c9-9a70-426ea089c6c4 admin admin] Deleting subnet ac7ab3af-328c-48b0-bebe-86a3fa1cf134 {{(pid=103244) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 24 11:32:33.498559 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4df53d4d-4baa-44c9-9a70-426ea089c6c4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.535980 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4df53d4d-4baa-44c9-9a70-426ea089c6c4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-4161249'] for subnet, precommit_delete_associations {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.603665 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 53980824-f312-4480-8664-cc03f9d7e928 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:32:33.621147 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4df53d4d-4baa-44c9-9a70-426ea089c6c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-8286535'] for subnet, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.628005 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 53980824-f312-4480-8664-cc03f9d7e928 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:32:33.628497 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 53980824-f312-4480-8664-cc03f9d7e928 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:32:33.628989 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:32:33.648276 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:32:33.648618 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 3b5e1ce0-4c5e-4d5c-81ea-9ed3052e9cf1 not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:32:33.750650 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4df53d4d-4baa-44c9-9a70-426ea089c6c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-8286542', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988778', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-8699037', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-8480512'] for subnet, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.775796 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4df53d4d-4baa-44c9-9a70-426ea089c6c4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ac7ab3af-328c-48b0-bebe-86a3fa1cf134,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:33.783348 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-4df53d4d-4baa-44c9-9a70-426ea089c6c4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for subnet, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.788713 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-4df53d4d-4baa-44c9-9a70-426ea089c6c4 admin admin] 10.222.0.76 "DELETE /v2.0/subnets/ac7ab3af-328c-48b0-bebe-86a3fa1cf134 HTTP/1.1" status: 204 len: 168 time: 0.3373642 Nov 24 11:32:33.789685 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6e6cc74c-b240-489b-a227-58713c10897a None None] Network 7e9bc114-a1bf-495d-a3b2-2df5b40b217e requested from dv-cinder-804035-18-iscsi {{(pid=103245) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 24 11:32:33.791578 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35880) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:33.866711 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-7930541'] for network, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.921237 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Deleting port 8ae3028e-95ab-472c-a6be-91d53c64405f {{(pid=103244) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:33.921567 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:33.993386 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.db [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] For port 8ae3028e-95ab-472c-a6be-91d53c64405f, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=8ae3028e-95ab-472c-a6be-91d53c64405f,segment=NetworkSegment(cae3f2af-a231-4163-8e6d-d9f38b413291),segment_id=cae3f2af-a231-4163-8e6d-d9f38b413291)] {{(pid=103244) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:32:33.993681 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.008051 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.plugin [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Calling delete_port for 8ae3028e-95ab-472c-a6be-91d53c64405f owned by network:dhcp {{(pid=103244) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:34.113803 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-508262aa-f61b-426c-9829-ba50df100ff8 None None] DHCP port deletion for 7e9bc114-a1bf-495d-a3b2-2df5b40b217e request from dv-cinder-804035-18-iscsi {{(pid=103245) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 24 11:32:34.159416 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-508262aa-f61b-426c-9829-ba50df100ff8 None None] Deleting port 8ae3028e-95ab-472c-a6be-91d53c64405f {{(pid=103245) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 24 11:32:34.159784 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-508262aa-f61b-426c-9829-ba50df100ff8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8789864131934'] for port, before_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.184336 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-8699072'] for port, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.211600 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Pushing event deleted for resources: {'Port': ['ID=8ae3028e-95ab-472c-a6be-91d53c64405f,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:34.214979 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] No DVR routers for this DVR port 8ae3028e-95ab-472c-a6be-91d53c64405f on host dv-cinder-804035-18-iscsi {{(pid=103244) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:32:34.224183 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.db [None req-508262aa-f61b-426c-9829-ba50df100ff8 None None] For port 8ae3028e-95ab-472c-a6be-91d53c64405f, host dv-cinder-804035-18-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804035-18-iscsi',level=0,port_id=8ae3028e-95ab-472c-a6be-91d53c64405f,segment=NetworkSegment(cae3f2af-a231-4163-8e6d-d9f38b413291),segment_id=cae3f2af-a231-4163-8e6d-d9f38b413291)] {{(pid=103245) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 24 11:32:34.224634 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-508262aa-f61b-426c-9829-ba50df100ff8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-942948'] for port, precommit_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.237296 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-508262aa-f61b-426c-9829-ba50df100ff8 None None] Calling delete_port for 8ae3028e-95ab-472c-a6be-91d53c64405f owned by network:dhcp {{(pid=103245) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 24 11:32:34.289335 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-8288370', 'neutron.services.segments.db._delete_segments_for_network-8789864228536'] for network, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.309262 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7e9bc114-a1bf-495d-a3b2-2df5b40b217e']}} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:34.311266 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-508262aa-f61b-426c-9829-ba50df100ff8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-7985735', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-35941', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8789864134512', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8789863700179'] for port, after_delete {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.318800 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cae3f2af-a231-4163-8e6d-d9f38b413291') {'for_net_delete': True} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:34.319090 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.services.segments.db [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cae3f2af-a231-4163-8e6d-d9f38b413291') {} {{(pid=103244) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 24 11:32:34.328638 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8789864256588', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-4161272'] for segment, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.339228 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508262aa-f61b-426c-9829-ba50df100ff8 None None] Pushing event deleted for resources: {'Port': ['ID=8ae3028e-95ab-472c-a6be-91d53c64405f,revision_number=None']} {{(pid=103245) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:34.341362 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.db.l3_dvrscheduler_db [None req-508262aa-f61b-426c-9829-ba50df100ff8 None None] No DVR routers for this DVR port 8ae3028e-95ab-472c-a6be-91d53c64405f on host dv-cinder-804035-18-iscsi {{(pid=103245) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 24 11:32:34.343959 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864'] for segment, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.351940 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Releasing vlan 1248 on physical network physnet1 to pool {{(pid=103244) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 24 11:32:34.352476 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-8286864', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-8699699'] for segment, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: Traceback (most recent call last): Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: timer() Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: cb(*args, **kw) Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: return func(*args, **kwargs) Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: self._notify() Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: self.callback(batched_events) Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: event.method(event) Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: aggregate_uuid = self.p_client.list_aggregates( Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: return f(self, *a, **k) Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._get(url).json() Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: return self.request(url, 'GET', **kwargs) Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: base_url = self.get_endpoint(auth, allow=allow, Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 24 11:32:34.354463 dv-cinder-804035-18-iscsi neutron-server[103244]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 24 11:32:34.458130 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-8288363', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-988869', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-637224', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-942815'] for network, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.466312 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-637242'] for network, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.469548 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] 10.222.0.76 "DELETE /v2.0/networks/7e9bc114-a1bf-495d-a3b2-2df5b40b217e HTTP/1.1" status: 204 len: 168 time: 0.6768780 Nov 24 11:32:34.480476 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c77ead3c-d823-4567-b2fb-1a9b215ea2b3 admin admin] Pushing event deleted for resources: {'Network': ['ID=7e9bc114-a1bf-495d-a3b2-2df5b40b217e,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:34.725743 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35884) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:34.764241 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-4158800a-6175-4946-8998-0a7e2997d032 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=c672667e55bd470cba00102a41b7ea85&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0373340 Nov 24 11:32:34.766527 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35886) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:34.813785 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e7eee425-7ccc-4af7-ad3d-70dc73fdf693 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.834485 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e7eee425-7ccc-4af7-ad3d-70dc73fdf693 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.932621 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e7eee425-7ccc-4af7-ad3d-70dc73fdf693 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.935166 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-e7eee425-7ccc-4af7-ad3d-70dc73fdf693 admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:34.936365 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-e7eee425-7ccc-4af7-ad3d-70dc73fdf693 admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/0136a3ca-283c-4ef9-bab2-3b05d55d1699 HTTP/1.1" status: 204 len: 168 time: 0.1689239 Nov 24 11:32:34.944013 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7eee425-7ccc-4af7-ad3d-70dc73fdf693 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0136a3ca-283c-4ef9-bab2-3b05d55d1699,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:35.559284 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35892) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:35.595563 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 8ae3028e-95ab-472c-a6be-91d53c64405f no longer exists at agent ovs-agent-dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 24 11:32:35.602523 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-c785758d-c872-41c6-90d1-6cf327b9e970 admin admin] 10.222.0.76 "GET /v2.0/security-groups?tenant_id=d3a0be31ba5a44fd9fa8f4eb91244039&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0420184 Nov 24 11:32:35.603781 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [-] (103244) accepted ('10.222.0.76', 35894) {{(pid=103244) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 24 11:32:35.615253 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.plugin [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] No Port match for: 8ae3028e-95ab-472c-a6be-91d53c64405f {{(pid=103245) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 24 11:32:35.615732 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron.plugins.ml2.rpc [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Device 8ae3028e-95ab-472c-a6be-91d53c64405f not bound to the agent host dv-cinder-804035-18-iscsi {{(pid=103245) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 24 11:32:35.655876 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0cb1e7de-5a9d-49e8-b3bb-04e3a27f31da admin admin] Publish callbacks [] for security_group, before_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:35.676137 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0cb1e7de-5a9d-49e8-b3bb-04e3a27f31da admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:35.795507 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0cb1e7de-5a9d-49e8-b3bb-04e3a27f31da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-983101'] for security_group, after_delete {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:35.798118 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron_lib.callbacks.manager [None req-0cb1e7de-5a9d-49e8-b3bb-04e3a27f31da admin admin] Publish callbacks [] for security_group, before_response {{(pid=103244) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:35.799269 dv-cinder-804035-18-iscsi neutron-server[103244]: INFO neutron.wsgi [None req-0cb1e7de-5a9d-49e8-b3bb-04e3a27f31da admin admin] 10.222.0.76 "DELETE /v2.0/security-groups/74983816-d7df-4c9f-853a-4b802ba6c787 HTTP/1.1" status: 204 len: 168 time: 0.1946197 Nov 24 11:32:35.810190 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb1e7de-5a9d-49e8-b3bb-04e3a27f31da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=74983816-d7df-4c9f-853a-4b802ba6c787,revision_number=None']} {{(pid=103244) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 24 11:32:38.749776 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-06443d04-271d-4709-a88e-bc498c6dd009 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:39.578184 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:41.149341 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-fb11ae81-7eb8-4953-af30-f88820e53fc5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:42.520463 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:44.092139 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:44.818153 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:32:51.062057 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:33:08.737495 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-0da21550-5bb3-497d-b594-35837e554fb7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:33:09.565654 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:33:11.142626 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-22643334-dfbe-4ec4-a3b0-a6a17f162e96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:33:12.509540 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:33:14.131236 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:33:14.920170 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:33:28.059886 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:33:38.776739 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c7fe231b-dd99-499d-9da0-62cbd8cd9e63 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:33:39.599649 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:33:41.131073 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d7f4ad33-c017-401f-be08-4a3d03ddd81d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:33:42.541875 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:33:44.130700 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:33:44.839285 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:34:05.058498 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:34:08.718433 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-317c387f-96dc-4466-9c0d-6fdb5464d0b1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:34:09.570572 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:34:11.141195 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-50737ac5-39cf-41e8-aace-d69f1bc349bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:34:12.495868 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:34:14.130153 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:34:14.786980 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:34:38.769864 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d4b4100f-e8a7-44b4-a272-a53aeffbce16 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:34:39.581468 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:34:41.157870 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-19917d8a-1a17-4222-b592-de44f65bf6bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:34:42.058425 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:34:42.523784 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:34:44.141142 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:34:44.804332 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:08.803409 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-7ba8de1b-d0ac-4e10-bcdb-5c6951d043cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:09.591876 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:11.134327 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-3a5c5c1b-2357-4e66-a5c5-cc72efd92c27 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:12.534982 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:14.157169 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:14.820606 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:19.056953 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:35:38.745823 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-cb1c030d-8897-4c10-8e0c-874dd1cc2309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:39.620402 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:41.190920 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-42824281-745d-480e-a09e-bbf5409ef192 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:42.568148 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:44.116953 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:44.813960 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:35:56.056140 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:36:04.126450 dv-cinder-804035-18-iscsi neutron-server[103243]: DEBUG neutron.wsgi [req-e632dda1-a46c-400c-b750-c09c752e55c3 req-22aaf4e5-b382-4373-80f0-05e43372cec4 service neutron] (103243) timed out ('10.222.0.76', 60386) {{(pid=103243) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 24 11:36:08.784819 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-541beb54-aebd-4f27-9b1b-0dd63c759d2a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:36:09.596185 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:36:11.127926 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-c223b543-d57b-475e-9e74-e3cf178e324b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:36:12.538501 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:36:14.138879 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:36:14.842459 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:36:33.054591 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:36:38.790103 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-3fc286b9-a871-4b9c-a714-3686c9f96cdf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:36:39.594974 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:36:41.127066 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e342c2f5-3537-4db9-95fa-c2fcd75c0e64 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:36:42.534353 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:36:44.150210 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:36:44.812703 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:08.765904 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-2437ee62-7502-40bf-9b9d-74ef575f50ae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:09.617725 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:10.055059 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 24 11:37:11.177947 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-40dc5729-be32-4300-8384-eda4703e50b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:12.526759 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:14.127595 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:14.806744 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:35.046724 dv-cinder-804035-18-iscsi neutron-server[103244]: DEBUG neutron.wsgi [req-9b8d9b2e-be0d-4d75-b164-f21283144450 req-cde97d3b-5c98-4981-9058-3e2fe9f8fb10 service neutron] (103244) timed out ('10.222.0.76', 57330) {{(pid=103244) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 24 11:37:38.783724 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-1d265bfa-ccc7-42c4-bd55-ce40eeb23693 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:39.622899 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-d23f3ef6-e708-41b0-a4e0-a014522ef4ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:41.131503 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-48085a80-2b15-4cf1-89db-8eb1b18f51e9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:42.531283 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-b256b020-d920-47bc-9866-9efd3474340e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:44.131478 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-e67417fd-c2aa-46dd-8d7b-9e43f8b76b6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:44.846481 dv-cinder-804035-18-iscsi neutron-server[103245]: DEBUG neutron_lib.callbacks.manager [None req-18a8a677-bd31-4f5f-a897-98e7b7078853 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8789864228545', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-8283228'] for agent, after_update {{(pid=103245) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 24 11:37:47.054188 dv-cinder-804035-18-iscsi neutron-server[103246]: DEBUG neutron.db.agents_db [None req-eb00abb6-4d8d-458f-8d48-773428b79fe3 None None] Agent healthcheck: found 6 active agents {{(pid=103246) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}